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This  p"' o  j e  't  addresses  the  problems  involved  in  developing  an 
interactive  software  system  that  integrates  adaptive  and  nonlinear  control 
design  procedures  with  a  real- tinu  processor  for  implementation.  The 
proposed  system  implements  complex  control  laws  in  the  laboratory  for  rapid 
testing  evaluation  and  tuning.  Recent  hardware  development  and  software 
methodologies  form  the  basis  of  compu4 er- ai ded  control  system  design  (CACSD) 
p^oduts.  The  two  basic  elements  defined  in  the  study  are: 


(1)  A  user  friendly  CACSD  software  package  for  product  development 
and  validation  of  control  laws  using  simulation  models 

(2)  A  real-time  hardware  system  which  can  automatically  implement 
control  laws  designed  by  the  CACSD  software  package,  without 
real-time  programming. 

The  products  proposed  under  this  project  will  significantly  reduce 
engineering  development  time.  Many  new  applications  will  occur  as  more  and 
mere  improved  CAE  tools  are  available  and  the  designed  control  laws  can  be 
rapidly  verified  in  the  laboratory.  The  hardware  will  be  capable  of 
i triple"  nting  optimal  trajectories  allowing  more  economical  operation  of 
process  'ants  and  automated  manufacturing  lines.  Advanced  control, 
guidance,  -d  estimation  methods  will  be  introduced  into  operational  systems 
rapidly  sine  •'evelopment  times  and  risks  will  be  reduced.  Easy  to  use 
laboratory  test  •  ->ols  will  eventually  change  policymaker's  decisions  on 
appropriate  funding  evels  for  new  complex  systems  development. 
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SECTION  1 
PROJECT  OVERVIEW 


1.1  NEEDS  IN  COMPUTER-AIDED  CONTROL  SYSTEM  DESIGN  (CASD) 

The  high  performance  requirements  and  complexity  of  modern  weapons, 
engines,  and  chemical  processes  have  made  it  necessary  to  use  sophisticated 
control  logic.  In  addition,  systems  must  operate  efficiently  over  a  wide 
range  of  conditions,  providing  the  incentive  to  develop  an 
"intelligent/adaptive"  feedback  controller.  The  controller  must  be  able  to 
implement  in  real-time  and  on-line  most  design  functions  now  performed  off¬ 
line  by  the  control  engineer.  To  realize  this  aim,  both  a  theory  of 
stability  and  performance  of  such  inherently  nonlinear  controls  is 
essential.  It  must  also  be  possible  to  implement  such  complex  control  laws 
in  the  laboratory  for  rapid  testing  evaluation,  and  tuning.  Recent 
advances  in  semiconductor  technology  and  architectures  have  made  it 
practical  to  rapidly  achieve  such  implementation. 

Two  principal  capabilities  are  needed  for  rapid  development  and 
testing  of  control  laws: 

x 

(1)  a  user-friendly  control  design  computer- aided- engineering  (CAE) 
software  package  for  development  and  validation  of  control  laws 
using  simulation  models,  and 

(2)  a  real-time  hardware  system  which  can  automatically  implement 
control  laws  designed  by  the  CAE  software  package.  No  real-time 
programming  should  be  necessary. 

Unfortunately,  a  user-friendly  software  system  which  can  work  in 
conjunction  with  a  compatible  real-time  processor  is  currently  not 
available.  Typically,  practical  synthesis  is  limited  to  a  trial  and  error 
time  consuming  procedure.  With  the  help  of  an  interactive  software  system 
that  integrates  adaptive/  nonlinear  control  design  procedures  and  real-time 
processor  implementation,  the  overall  set-up  time  in  the  control  design 
cycle  can  be  reduced  significantly. 


The  objective  of  this  Phase  I  activity  is  to  define  a  hardware  and 
software  real-time  system  with  capability  to  demonstrate  successful 
nonlinear  and  adaptive  control  for  aerospace  systems  in  laboratory  hardware- 
in-the-loop  testing.  The  Phase  I  study  has  established  the  usefulness  and 
feasibility  of  developing  an  integrated  CACSD  system. 

1.2  SUMMARY  OF  PHASE  I  RESEARCH  -  THEORY  DEVELOPMENT  AND  FEASIBILITY  STUDY 

The  Phase  I  research  (period  of  performance  is  15  September  1984  to  1*4 
March  1985)  obtained  quantitative  measures  for  the  performance  and  stability 
of  adaptive  control  systems.  Results  to  date  have  established  the 
following: 

(1)  Conditions  for  robustness,  stability,  and  performance  with 
respect  to  unmodeled  plant  dynamics  and  disturbances. 

(2)  Regions  and  rates  of  convergence  with  respect  to  unmodeled 
dynamics  and  disturbances. 

These  results  extend  the  theory  of  adaptive  control  to  more  practical 
engineering  environments.  They  also  provide  the  means  to  monitor  the 
stability,  performance,  and  convergence  of  adaptive  systems  during 
transients.  Thus,  the  theory  establishes  engineering  guidelines  for  an 
outer  control  loop  whose  purpose  is  to  coordinate  system  performance  and  to 
provide  intelligence  for  changing  plant  parameters  and  operating  conditions. 
These  results  are  also  directly  applicable  to  nonlinear  and  multi-rate 
control  laws  for  nonlinear  systems. 

The  results  produced  in  Phase  I  are  the  product  of  several  years  of 
collaborative  efforts  to  develop  a  theory  of  robustness  for  adaptive 
systems.  A  summary  of  the  Phase  I  research  is  contained  in  Section  2. 
Related  selected  references  include  Kosut  and  Friedlander  (198',  1985), 

Kosut  and  Anderson  (1984.  1985)  and  Kosut  and  Johnson  (1984,  see- also 
Appendix  A). 


1.3  SUMMARY  OF  PREVIOUS  WORK  AT  ISI  -  REAL-TIME  IMPLEMENTATION 


Concurrent  with  the  Phase  I  theory  development,  ISI  has  also  pursued 
the  development  of  a  real-time  control  processor  which  is  capable  of 
implementing  nonlinear  control  laws,  including  parameter  adaptive  control, 
on-line  system  identification,  and  gain-scheduled  control.  This  work  is 
currently  being  supported  in  part  by  internal  funding  and  by  the  U.S.  Army 
'AMCCOM).  Past  support  has  also  come  from  the  U.S.  Air  Force  (AFWAL).  The 
real-time  processor  utilizes  the  same  data  structures  as  ISI's  existing 
simulation  and  analysis  software  product  MATRIX^  (see  Section  S'*-  Hence, 
candidate  designs  can  be  rapidly  implemented  and  tested  in  a  laboratory 
environment . 

ISI's  processor  is  named  the  MAX  100  (MATRIX^  Architecture  Executive). 
The  MAX-100  will  be  an  essential  element  for  testing  prototype  control  laws 
and  provides: 

(1)  rapid  implementation  of  control  laws  -  no  real-time  code  need  be 
written; 

(2)  extensive  diagnostics  for  debugging; 

(3)  easy  maintenance  -  MAX-100  shares  model  catalogs  and  data  bases 
with  MATRIXX. 

A  det  iled  discussion  of  these  issues  can  be  found  in  a  paper  by  Shah, 
Walker,  and  Saberi  (1985)  included  as  Appendix  B.  Other  references  include 
Walker,  Shah,  and  Gupta  (19841  and  Shah,  Floyd,  and  Lehman  (1985). 

Though  the  development  of  this  processor  has  provided  significant 
experience  in  real-time  control  systems,  further  work  is  needed  to  develop  a 
complete  system  for  aerospace  use. 


1.4  SCOPE  OF  REPORT 

The  next  section  is  orgaanized  to  emphasize  the  parallel  development 
of  the  software  simulation/ analysis  toolkit  and  the  compatible  architecture 
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SECTION 

RESULTS  OF  PHASE  1  RESEARCH 


This  section  provides  a  detailed  summary  of'  Phase  I  results.  The 
Section  is  divided  into  a  discussion  first  of  software  tools  for  adaptive 
and  nonlinear  algorithms,  and  then  a  discussion  of  real-time  processor 
implementation  issues, 

2.1  SOFTWARE  TOOLS  FOR  ADAPTIVE  SYSTEMS 

Successful  implementation  of  adaptive  systems  requires  close  attention 
to  theoretical  algorithmic  aspects  and  har dwar e/software  compatibility. 

Adaptive  control  schemes  have  the  generic  form  shown  in  Figure  2-1  and 
differ  only  in  internal  characteristi cs  such  as: 

(1)  model  parametri zations 

(2)  parameter  adaptive  algorithms 

(3)  control  design  algorithms 

The  basic  software  tools  which  are  needed  for  analysis  of  adaptive 
system?  include:  -< 

(1)  Interactive  graphical  block  diagram  manipulations.  ;] 

(2)  Analysis  tools  for  evaluating  system  performance,  e.g.,  stability 

and  parameter  convergence.  , 

The  MATRIX^  software  system  currently  incorporates  the  SYSTEM_BUILD 
feature  (see  Section  3)  which  is  capable  of  general  block  diagram 
manipulation,  but  will  have  to  be  specialized  further  for  adaptive  system 
forms.  ...! 


6 


Disturbances 


Obitctives 


Figure  2-1.  Adaptive  Control  System 

Specifically,  the  software  tools  should  allow  the  user  to  select  from 
a  catalog  of  standard  adaptive  system  algorithms  corresponding  to  the 
internal  characteristics  listed  above.  For  example,  the  user  could  select 
from  the  following  types  of  catalogs: 

Model  Control  Design  Adaptation 

Gradient 

Recursive  Least  Squares 
Recursive  Max  Likelihood 
Extended  Kalman  Filter 


ARMAX 

State-Space 


Model  Reference 
Self -Tuning 
Pole-Placement 


I^IM 


Within  each  sub-topic  the  user  would  then  be  given  a  more  detailed 
choice  based  on  more  detailed  characteristi cs  and  a  priori  system  knowledge 
of  dynamics  and  disturbances.  Of  course,  the  experienced  user  can  by-pass 
those  choices  and  create  any  other  algorithm.  “ 

% 

The  tools  needed  for  evaluating  performance  do  not  depend  on  the  use-  " 

choice.  These  tools  include  testing  operators  for  SPR  (strict  positive 
real),  and  testing  signals  for  persistant  excitation,  forming  the  ODE  (Ordi¬ 
nary  Differential  Equation),  and  performing  averaging  analyses.  The  ( 

following  subsections  briefly  describe  these  tests.  " 


2.1.1  SPR  Condition  and  Testing 


The  SPR  condition  arises  in  the  proof  of  stability  of  practically  all 
adaptive  schemes,  e.g.  Kosut  and  Johnson  (1984)  and  Appendix  A.  Hence,  it 
is  very  important  to  provide  the  means  to  test  that  the  SPR  condition  holds. 
This  will  involve  both  on-line  and  off-line  testing  proceedures.  For 
example,  in  analyzing  a  particular  combination  of  adaptive  algorithm  and 
system  model,  the  SPR  test  is  off-line.  In  the  case  where  the  algorithm  is 
being  implemented  in  the  real-time  processor,  the  test  is  on-line. 


To  illustrate  how  the  SPR  condition  arises,  consider  a  system  in  ARMAX 


form. 


A (q  1  )yt  =  B (q  1 )ufc  +  C(q  1 )vfc 


where  A,  B,  and  C  are  polynominals  in  the  delay  operator  q  1 ,  i.e.,  q  1x, 


xt_-]  •  A  typical  identification  model  of  the  above  system  has  the  linear 


predictor  form 


yt  ■  e  *t-i 


[  y  t_  1 1 y 2  •  •  •  • » ^  ut~2  •  •  •  •  ^ 


( 

- 


■  .**  .*•  .*•  .**  V 


.*• 


t-i 


However,  the  actual  (optimal  stationary)  predictor  is 


1 


C  (q  ') 


T 

0  ♦  , 
o  t-1 


where  0  consists  of  the  coefficients  in  A(q  1 )  and  B(q  1).  As  a  result  of 
o 

this  approximation  the  SPR  condition  arises  to  prove  stability,  e.g., 

- 1  i  - 1 

[C(q  )  -  — ]  should  be  SPR  for  the  least  squares  update  and  C(q  )  should  be 
SPR  for  the  gradient  update  (see  e.g.,  Ljung  and  Soderstrom,  1983,  or 
Goodwin  and  Sin,  1984). 


By  stability  is  meant  that  the  parameter  estimates  and  all  relevant 
signals  are  bounded.  The  parameter  estimates  may  not  converge  to  the  true 
value  nor  to  any  fixed  value.  Conditions  for  parameter  convergence  involve 
a  richness  in  frequency  content  of  the  regressor  vector  <)>(t),  refered  to  as 
persistent  excitation ,  which  is  discussed  below. 

A  multivariable  transfer  matrix  H(q  1 )  can  be  tested  for  SPR  in  the 
frequency  domain  (Desoer  and  Vidyasagar,  (1975).  The  result  is  that  H(q  1  ) 
is  SPR  if  and  only  if  the  transfer  matrix 


G(q  1 )  =  ( I  +  H(q-1))_1 


is  stable  and 

o  [G(e^6)]  <  1,  -tt < e <tt 
max 


where  o  denotes  the  maximum  singular  value.  Once  having  obtained  H(q  1 ) 
it  is  a  straightforward  matter  to  perform  the  singular  value  test  using 
existing  MATRIX^  software.  The  difficult  part  is  to  obtain  H(q1)  in  the 
first  place,  for  a  given  adaptive  system.  The  requisite  H(q  1 )  depends  on 
the  algorithm  and  tools  needed  to  obtain  it  both  on  line  and  off-line,  (see 
Kosut  and  Johnson,  1984  in  Appendix  A  for  a  precise  definition  of  H(q  1 ) ) . 


2.1.2  Persistent  Excitation 


When  the  appropriate  operator  H(q  1 )  is  SPR,  the  adaptive  system  is 
stable  and,  hence,  the  adaptive  parameters  are  bounded.  To  guarantee 
parameter  convergence  requires  that  the  regressor  vector  $(t)  is  PE 
(persistently  exciting),  i.e.,  there  exists  an  integer  N  and  a  positive 
constant  a  such  that 


\ 


min 


s+N-1 

^  l  <t>(t)<j>(t)T  }  >  a 

t=s 


for  all  integers  s,  where  is  the  minimum  eigenvalue  (see  e.g.  Anderson 

and  Johnson,  1982).  The  ability  to  perform  the  PE  test  is  a  necessary  tool 
for  on-line  and  off-line  monitoring  of  adaptive  system  performance. 

2.1  3  Tools  for  ODE  Analysis 

The  ODE  (Ordinary  Differential  Equation)  analysis  for  adaptive 
systems,  developed  by  Ljung  (1977),  is  used  to  determine  the  adaptive  system 
asymptotic  behavior.  The  basic  idea  is  that  the  parameter  estimates  0(t)  of 
the  adaptive  system: 


Figure  2-2.  Basic  Structure  for  ODE  Analysis 


will  asymptotically  approach  the  trajectories  of  the  ODE: 


~  0  =  R~ 1 f (0) 
at 

~~  R  =  G(0)  -  R 
at 

The  nonlinear  functions  F  and  G  can  be  estimated  using  the  covariance 
estimate  P(t)  and  the  known  plant/controller  combination  (see  Ljung,  1977 
for  details). 

The  ODE  analysis  is  based  on  a  theory  of  stochastic  averaging  and 
assumes  that  the  parameters  are  near  convergence.  Hence,  the  results 
provide  necessary  conditions  for  convergence.  More  general  averaging 
results  are  described  next.  These  results,  in  some  cases,  are  necessary  and 
sufficient  for  parameter  convergence. 


2.1.11  Tools  for  Averaging 

Adaptive  algorithms  generally  have  the  form 


Q(t)  =  0 ( t —  1 )  +  e  f (t-1 ,Q(t-1 )  ,5(t-1  )j 
S(t)  =  g(t-1,0(t-1),E(t-1)) 


where  0(t)  is  the  adaptive  parameter  estimate  and  E(t)  is  a  vector 
consisting  of  all  other  system  states.  The  functions  f  and  g  correspond  to 
the  algorithm  and  system  description,  respectively.  The  parameter  t  is  the 
step-size.  When  e  is  small  we  can  analyze  the  "average"  system 


e(t)  =  0(t-i)  +  e  f (e(t-i)) 


B 

ik 
j  k 
l  . 

a 

V 


s+n-1 

where  f(0)  =  I  f(t,0,o) 
t=s 

Thus  0(t)  is  "slow"  compared  to  the  "fast"  states  £(t).  in  the  case  when 
the  system  is  linear  the  convergence  properties  of  the  averaged  system  can 
be  determined  in  the  frequency  domain  using  a  generalized  positivity  test  of 
the  form. 


is 

I' 


A 


min 


j  J  Re[a  a  ]  Re  [H(e^wm)]} 
1  u  mm  ' 

m=o 


>  0 


where  a  and  w  are,  respectively,  the  Fourier  series  coefficients  and 
mm  ^ 

exponents  of  the  regressor  vector,  and  H(q  )  is  the  operator  as  defined  in 
Section  2.1.1  (see  e.g.  Riedle  and  Kokotovic,  1984;  Kosut ,  Anderson,  and 
Mareels,  1985). 

This  condition  is  significantly  weaker  than  the  usual  SPR  condition 

Re(HeJui)  >  0  which  is  tested  for  all  frequencies  u.  The  above  averaging 

test  is  a  sum  and  Re  H(e^w)  >  0  is  required  only  when  Re  To  a  *]  is  large. 

mm 

The  class  of  signals  which  can  be  tested  in  this  way  is  larger  than 
those  allowed  in  the  ODE  theory.  Also,  the  test  is  easily  implemented  by 
using  the  standard  signal  analysis  techniques  to  find  the  Fourier  series  of 
a  function.  One  immediate  result  is  that  if  the  test  fails  it  is  possible 
to  augment  the  input  signals  in  the  frequency  range  where  more  signal  is 
needed.  Those  features  are  easily  incorporated  into  the  algorithm  as  well 
as  the  real-time  system. 


it 
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2.2  NONLINEAR  CONTROL  DESIGN  BY  GAIN  SCHEDULING 

Adaptive  control  can  be  considered  as  a  nonlinear  control  with  a 
special  structure.  A  highly  successful  approach  to  nonlinear  control  design 
which  shares  this  same  special  structure,  is  gain-scheduling.  In  fact,  this 
approach  can  be  applied  to  any  nonlinear  control  problem.  Because  parameter 
adaptive  control  and  gain  scheduling  control  share  the  same  basic  structure, 
the  real-time  processor  and  software/simulation  toolkit  can  easily  provide 
for  both.  The  following  discussion  illustrates  the  basic  requirements  for 
gain  scheduling 

A  typical  gain- scheduled  control  system  is  shown  in  Figure  2-3,  where  P  is 
the  plant  (aircraft),  d  is  an  output  disturbance,  and  C  is  the  gain- 
scheduled  controller,  whose  gains  are  scheduled  as  a  function  of  the  actual 
trajectories  (u,y).  Note  that  C  maps  output  error  signals  y:=y-y  into 
control  error  signals  u  =  u  -  u. 

The  first  step  in  obtaining  C  is  to  design  a  collection  of  linear 
controllers  based  on  linear  models,  each  corresponding  to  a  particular 
reference  trajectory  (u,y).  Thus,  the  resulting  controller  gains  are  a 
function  of  the  reference  condition  (u,y).  The  control  gains  are  then 
"scheduled"  as  functions  of  the  actual  condition  (u,y)  to  achieve  a 
continuous  nonl inear  control  throughout  the  operating  envelope. 


Corn  rol  )ct 
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Scheduling  the  gains  can  be  accomplished  using  a  variety  of  interpola¬ 
tion  or  regression  fitting  schemes.  The  choice  depends  largely  on  the 
capabilities  of  the  hardware  in  which  the  algorithm  will  be  implemented  and 
the  complexity  of  the  gain  schedule.  This  technique  is  well  est-ablished , 
having  been  applied  to  many  flight  control  systems. 

The  gain  scheduling  design  procedure  involves  several  models  of  the 

actual  plant  P.  A  high  fidelity  nonlinear  model,  denoted  by  P  is 

N  L 

developed  either  analytically  from  physical  laws,  or  numerically  from  flight 

data.  Often,  P.t.  ,  is  a  combination  of  both.  A  set  of  reference 
_NL_ 

trajectories  (u.,y.),  i  =  1,  _ _  k  are  determined  from  P.„  ,  i.e., 

11  NL 

*i  =  pnlV  1  "  1 . k 

Each  reference  (u^.y^)  generates  a  linear  perturbation  model ,  denoted 

by  P^  .  This  model  can  be  obtained  as  a  first  order  perturbation  of  P  , 
i 

i.e., 

PNL(V  U)  =  PNLGi  +  PL  U  +  0(IM|2) 

l 

Repeating  for  k  selected  flight  conditions  (u^.y^),  i  =  1,  ...,  k  yields  a 

corresponding  collection  of  linear  models  {P  ,...,P  }.  In  the  case  when 

L1  Lk 

(u.,y.)  is  an  equilibrium  then  u.  and  y.  are  constants  and  P,  is  LTI.  When 

11  11  Li  . 

1 

(u.,y,)  is  a  dynamic  trajectory  then  P,  is  LTV  (linear  time  varying). 

1  1  "  L  , 

1 

Usually  only  quilibria  are  selected,  however,  to  fully  account  for  the 
behavior  of  high  performance  aircraft,  it  is  necessary  to  consider  dynamic 
references  as  we. 1  as  equilibrium  references. 


Having  determined  a  collection  of  linear  models  (P  .  ...,P  } 

L1  _  Lk 

corresponding  to  the  k-nominal  trajectories  { (u^ ,y1 ) , . . . (u  ,yk) } ,  any  number 

of  design  techniques  can  be  used  to  determine  a  set  of  linear  controllers 

{ , ...C^  }.  The  ith  linear  controller  is  indirectly  a  function  of  the 
1  k  1 

ith  trajectory  (u^y.).  Connecting  this  collection  of  controllers  as  a 

function  of  the  actual  (u,y)  is  "gain  scheduling".  The  resulting  controller 

C  is  nonlinear.  The  same  scheduling  procedure  can  be  used  to  connect  the 

collection  of  linear  models.  The  resulting  nonlinear  model  is  often 

referred  to  as  a  "simplified  nonlinear  model",  denoted  by  P  . 

O  m  Lj 

A  fundamental  issue  in  the  gain- schedul ing  procedure  is  that  there  is 
no  theoretical  justif ication  that  the  resulting  nonlinear  (gain  scheduled) 
control  will  provide  acceptable  performance  while  the  vehicle  is  in  transit 
from  one  flight/power  condition  to  another.  The  difficulty  lies  in  the  fact 
that  the  linear  models  are  only  known  to  be  valid  at  specific  conditions. 

The  effectiveness  of  the  linear  model  P  in  the  neighborhood  of  the  ith 

Li  . 

1 

reference  (u. ,y. )  can  be  evaluated  from  the  test  set-up  shown  in  Figure  2-4. 


Multi-rate  control  laws  refer  to  hierarchical  control  laws  consisting 
of  systems  with  more  than  one  sample  rate.  In  the  context  of  adaptive 
control  it  is  typical  to  perform  identification  update  at  a  slower  rate  than 
the  control  law  implementation. 


Note  that  each  of  the  subsystems  has  a  synchronous  timing  and  can  typically 
be  considered  as  performing  a  separate  task.  This  decomposition  corresponds 
to  the  user-defined  decomposition  based  on  the  functionalities  of  the 
control  law  subsystem.  Often  these  functionalities  are  defined  by  appealing 
to  separation  of  time  scales. 

Some  of  these  tasks  can  be  tied  to  a  specific  processor  in  the  system. 
In  particular,  D/A,  A/D,  and  continuous  signal  prefiltering  functions  are 
typically  tied  to  a  processor  capable  of  performing  analog  I/O.  Those  tasks 
that  run  on  the  same  processor  have  to  share  the  computation  resources. 

Strategies  for  scheduling  these  tasks,  assigning  them  to  specific 
processors,  managing  synchronization,  and  sharing  of  data  among  tasks 
running  on  many  processors  requires  a  careful  design.  Implementation  of 
such  a  system  requires  significant  effort  in  systems  programming.  Note  that 
each  of  the  tasks  have  to  be  executed  periodically.  Failure  to  finish  any 
of  the  tasks  on  time  constitutes  a  potential  failure  of  the  overall  control 
law. 


In  order  to  ensure  integrity  of  timing,  a  real-time  clock  must  provide 
interrupts  for  scheduling  all  periodic  activities  in  the  system. 


Hardware  Subsystems 

Typical  algorithms  used  for  adaptive  control  and  gain  scheduled 
control  impose  computational  burdens  that  require  special  purpose  hardware 
for  implementation  if  the  parameter  update  rates  exceed  20Hz  on  systems  of 
order  ten  or  greater  (see  Shah,  Walker,  and  Saberi,  Appendix  B). 

Among  the  various  functions  required  by  such  a  hardware  system  are: 

I.  Analog  to  Digital  to  Analog  conversion,  Antialiasing  filters  with 
programmable  bandwidth.  Accurately  timed  A/D  and  D/A  operations 
to  provide  clean  data. 
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II.  High  performance  (2MFL0PS  or  more)  floating  pt .  processor  capable 
of  performing  the  entire  nonlinear  block  diagram  update  without 
imposing  system  bus  traffic  overhead.  Tasks  that  could  be 
performed  in  parallel  should  be  split  and  loaded  in  individual 
floating  point  processors  thereby  increasing  the  overall 
throughput . 

III.  User  interface,  overall  system  management,  disk  I/O  management 


It  is  natural  to  specify  an  architecture  where  individual  modules  are 
specialized  to  handle  each  of  the  three  tasks  above. 


Major  vendors  such  as  Intel,  DEC,  and  Motorola  provide  modules  which 
provide  general  purpose  machines  in  the  form  of  single- board  computers,  disk 
controllers,  CRT/video  controllers,  etc. 


Analog  I/O  Module 


There  are  numerous  vendors  that  supply  A/D,  D/A  cards  for  various 
bases  but  most  of  them  are  specialized  for  Data-Acquisition  rather  than 
real-time  control  so  that  clean  data  with  simultaneous  sampling  of  channels 
at  high  throughput  rates  is  not  easily  achievable.  I/O  subsystems  with 
integral  programmable  antialiasing  filters,  accurate  timing  and  low  system 
overhead  are  not  available  and  have  to  be  designed.  Such  a  module  should 
also  include  autoranging  capability  for  an  increased  numerical  range  (up  to 
20  hits).  The  throughput  rate  per  channel  must  be  at  least  5KHz.  The 
analog  I/O  module  must  work  without  needing  servicing  from  other  processors. 


Floating  Point  Module 


High  throughput  numerical  modules  available  from  vendors  such  as  SKY 
computers  can  provide  about  1MFL0P0S  for  vector  operations.  In  order  to 
achieve  5  to  10  MFLOP  effective  throughput  a  floating-point  board 
specialized  for  numerical  functions  involved  in  adaptive  control. and 
nonlinear  control  should  be  designed.  Such  a  processor  would  have  the 
following  basic  architecture . 
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Figure  2-6. 


Structure  of  the  Simulation  Engine 


The  floating  point  simulation  engine  consists  of  a  fast  multiplier  and 
a  fast  floating  point  ALSL  for  arithmetic  operations  such  as  add,  subtract, 
absolute  value,  fix-float  conversions,  normalization,  and  comparisons.  The 
register  files  above  act  as  a  high  speed  pipelined  multipost  switches 
capable  of  routing  both  data  and  code  at  the  speed  of  the  two  processing 
elements  (PE).  The  microcode  ROM  sequences  orchestrates  the  activities  of 
the  PEs  and  the  register  file  switches.  Local  storage  of  data  and  instruc¬ 
tions  is  on  a  high  speed  RAM  on  the  left. 


The  key  is  to  have  all  the  computations  required  for  function 
evaluation  in  real-time  control  block  diagram  update  performed  on  the  high 
speed  floating  point  module  with  no  intermediate  system  bus  transfers. 


This  goal 


I 


requires  development  of  the  following  capabilities: 


(1)  Basic  arithmetic  operations  divide,  absolute  comparisons. 


(2) 


I 


Square  root,  tri gnometri c ,  and  hypertri gnometri c  functions,  log 
and  exponential  functions. 
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(3)  Vector  operations. 

( ^ )  Individual  block  updates  consisting  of  vector  operations 


vr  F(vV 


yk  *  H(vV 


(5)  Individual  subystem  update  consisting  of  block  updates  and 
resolution  of  interconnections  among  blocks. 


System  Management  and  General  Purpose  Machines 


Among  the  available  mi crocomputer  families  and  buses,  Intel's  Multibus 
based  single-board  computers  provide  the  best  match  for  high  performance  and 
functionality  offered  by  their  product  line.  An  important  criterion  in 
selecting  Intel's  family  of  products  is  the  availability  of  hardware 
floating  point  modules  80287  and  8087  along  with  a  mature  set  of  languages 
and  operating  tools  to  handle  the  entire  family  of  products. 


Figure  2-7  describes  one  particular  configuration  currently  being  used 
for  a  real-time  control  application. 


2.U  REQUIREMENTS  FOR  SOFTWARE  AND  HARDWARE 


x  A  representative  toolkit  for  various  phases  of  adaptive  and  nonlinear 
control  mechanization  can  now  be  described.  There  are  two  distinct 
environments  -  an  analysis  and  simulation  environment  and  a  real-time  imple¬ 
mentation  environment.  Both  environments  share  the  same  model  definition 
data  structure.  The  top  three  blocks  in  Figure  2-8  represent 
analysis/simulation,  while  the  bottom  two  refer  to  real-time  processing. 
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Figure  2-8.  Adaptive  Control  Mechanization  Process  and  Tools 


22 


The  needs  for  computer-aided  development  and  implementation  of 
adaptive  and  nonlinear  control  laws  are: 

(1)  Development  of  a  user-friendly  software  simulation  ant!  analysis 
toolkit  for  various  phases  of  adaptive  and  nonlinear  control 
mechanization. 

(2)  Development  of  an  efficient  transfer  procedure  from  the 
simulation/ analysis  environment  to  the  real-time  processor 
environment . 

2. ^ . 1  Software  Simulation/Analysis  Toolkit 


Specific  objectives  to  develop  the  toolkit  are  as  follows: 


I.  Provide  an  interactive  graphical  model  building  tool  with  the 

following  features: 

(1)  Dynamical  systems  of  nonlinear  differential  equations  can  be 
developed  from  block  diagrams. 

(2)  The  models  can  have  a  hierarchical  structure  -  submodels  can 
be  imbedded  inside  larger  models. 

(3)  Model  catalogs  can  be  treated  like  data  bases. 

(if)  Nonlinear  models  can  be  linearized  about  selected  equili¬ 
briums  or  nominal  trajectories. 

(5)  Model  error  measures  which  are  used  in  robustness  testing 
can  be  easily  obtained  for  either  linear  on  nonlinear 
systems. 

II.  Provide  a  work-station  capable  of  data  acquisition,  on-line 

system  identification  and  signal  processing  with  the  following 

features: 

(1)  Parametric  models  for  system  identification  can  be  de¬ 
veloped  from  a  catalog  of  choices  or  from  block  diagram 
building. 

(2)  Data  for  system  identification  can  be  acquired  either  from  a 
simulated  evaluation  model  (as  in  I)  or  from  a  real-time 
data  source. 


III.  Provide  an  interactive  adaptive  control  and  identification 
algorithm  building  tool  such  that: 


(1)  The  novice  user  can  rely  on  automatically  selected 
algorithms  based  on  the  structure  of  the  problem.  Default 
parameters  for  the  algorithm  should  work  in  most  cases. 

(2)  The  expert  user  can  select  the  algorithm  and  the  associated 
design  parameters  to  gain  full  control  over  the 

optimi zation . 

(3)  Extensive  diagnostics  can  be  made  available  in  case  of 
algorithmic  difficulty,  ill-conditioning  of  the  problem  or 
the  algorithm.  Heuristics  to  overcome  these  difficulties 
should  be  programmed  where  appropriate.  The  user  should  be 
able  to  obtain  explanation  of  the  heuristics  and  choices  of 
alternatives  Some  of  the  diagnostic  tools  include  on-line 
and  off-line  testing  procedures  for: 

(a)  passivity  and  other  input/output  sector  conditions 

(b)  persistent  excitation  of  signals 

(c)  stability  and  performance  robustness 

(d)  parameter  convergence 

(e)  linearization 

(f)  ODE  and  averaging  analyses. 


The  results  of  the  Phase  I  effort  have  provided  the  basic  theory  and  means 
to  perform  many  of  these  diagnostic  tests 


2.4.2  Design  of  the  Hardware  -  Real-Time  Control  System 


The  real-time  control  system  design  objectives  are  as  follows: 

I.  Provide  a  simple  system  for  rapid  implementation  of  adaptive  and 
nonlinear  real-time  control  systems  which  facilitates  the  proto¬ 
type  development  and  testing  phase  of  control  law  implementation. 
It  should  operate  on  the  data-base  generated  by  the  software 
analysis/  simulation  tool-kit. 

(1)  The  real-time  control  interface  for  editing  and  examining 
should  be  in  terms  of  the  graphical  block  diagram  entered  by 
the  user  in  the  design  and  simulation  software. 

(2)  The  user  should  be  able  to  modify  various  aspects  of  this 
block  diagram  on  the  real-time  control  system  so  that  the 
real-time  system  can  be  operated  without  requiring  access  to 
the  design  and  simulation  software. 

(3)  The  communication  link  between  the  design  software  and  the 
real-time  control  system  must  be  a  fast  and  single  command 
on  each  system. 
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II.  The  real-time  system  should  be  able  to  process  analog  signals 
from  a  physical  plant,  provide  performance  measures  of  the 
controlled  system,  and  perform  data  acquisition. 

(1)  The  user  should  be  able  to  connect  the  real-time  control 
system  directly  to  the  physical  plant  being  controlled  with 
standardized  analog  signals  (*)-20  ma  current  loop  or  _+5v 

bi polar. 

(2)  The  sampling  of  analog  signals  must  be  precise  and  none  of 
the  sample  times  should  be  dependent  upon  the  computation 
delays . 

(3)  The  real-time  control  system  must  have  extensive  error 
handling  capabilities  that  relate  to  computational  burden, 
numerical  exceptions,  missed  timings,  and  integrity  of 
shared  data  in  a  multiprocessor  environment.  Performance 
measures  include  signal  statistics,  idle  time  on  various 
processors,  and  memory  usage.  The  user  should  be  able  to 
configure  various  statistical  algorithms  to  operate  on  top 
of  the  control  system  to  give  performance  data  and  store  it 
on  a  secondary  storage  such  as  a  hard  disk. 

III.  Provide  high  computational  capability  as  well  as  numerical 
accuracy  as  required  during  the  prototyping  phase. 

(1)  Provide  both  floating  point  and  fixed  point  arithmetic. 
Floating  point  arithmetic  format  should  conform  to  the  IEEE 
75 ^  standard.  Most  high  performance  floating  point  hardware 
being  designed  today  conforms  to  the  IEEE  floating  point 

f  or mat . 

(2)  Prototyping  phase  requires  the  user  to  experiment  with 
options  that  usually  require  more  computational  capabilities 
than  the  one  required  by  the  target  system  hardware.  A 
floating  point  hardware  capability  in  excess  of  5  million 
floating  point  operations  per  second  is  required  for 
achieving  10-100  hz  identification  update  rate  on  systems  of 
order  5  to  10. 

(3)  The  architecture  of  such  a  floating  point  hardware  must  be 
optimized  to  give  high  throughput  for  real-time  control 
algorithms.  In  contrast  with  array  processor  archi tectures 
available  today,  the  pipelining  of  data  and  instruction  must 
not  be  allowed  to  generate  loop  delays. 

IV.  It  should  require  no  real-time  programming  from  the  user.  The 
user-interface  should  make  the  system  readily  accesible  to  non- 
progr  ammers  . 

All  the  considerations  described  for  the  user  interface  above  apply  to 
the  user  interface  of  the  real-time  control  system. 


Section  3 
RELATED  WORK 
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Integrated  Systems,  Inc.  (ISI)  has  been  performing  a  significant 
amount  of  work  in  the  general  area  of  computer-aided-engineering  for  system 
analysis  with  particular  emphasis  on  control  design  and  simulation.  The 
work  involving  development,  maintenance,  and  enhancements  to  MATRIX^  was 
funded  by  ISI  internally. 

ISI  has  also  developed  a  real-time  control  design  processor  under  U.S 
Army  funding.  The  processor  has  been  modified  for  general  purpose  use  and 
is  called  the  MAX-100.  Several  projects  are  researching  other  aspects  of 
CAE  technology  for  control  design,  implementation,  and  validation.  MATRIX^ 
currently  is  being  used  by  over  thirty  companies,  research  laboratories,  and 
universities,  including  Lockheed,  General  Motors,  M.I.T.,  and  the  Air  Force. 


3.1  IN-HOUSE  DEVELOPMENTS:  MATRIX 

x 

MATRIX^  provides  the  following  interactive  capabilities: 

'  1.  Control  and  estimator  design 

2.  System  identification  and  signal  processing 

3.  Interactive  model  building  (SYSTEM_BUILD ) 

U,  Simulation  and  evaluation 

Matrix  algebra,  interactive  graphics,  and  model  catalog  management  support 
these  capabilities.  Figure  3"1  shows  the  structure  of  MATRIX^.  In  the 
following,  we  describe  the  control  design,  model  building,  and  simulation 
capabilities  of  MATRIX  . 
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Figure  3"1 •  MATRIX^  Software  Architecture 


Control  Design  and  Analysis 

Control  design  in  MATRIX^  can  be  based  on  any  of  the  following: 

(a)  Classical  methods  including  root  locus,  Bode,  Nyquist,  and  Nichols 
(single- input/output  or  multivariable  plants) 

(b)  Linear-Quadratic-Gaussian  (LQG) 

(c)  Methods  based  on  A-B  invariant  subspaces 

(d)  Eigenstructur e  assignment  and  zero  placement 

(e)  Adaptive  control  using  self  tuning  regulators  and  other  techniques 

These  capabilities  are  available  for  use  with  both  continuous  and  discrete 
systems . 

For  the  LQG  problem,  the  algebraic  Riccati  equation  is  solved  from 
extended  Hamilton  equations,  avoiding  inverses  which  are  troublesome  in  the 
singular  case.  The  equations  are  row  compressed  with  an  orthogonal 
transformation  followed  by  the  QZ  pencil  decomposition. 
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TABLE  3-1.  MATRIX  CAPABILITIES:  CONTROL  DESIGN  AND  SYSTEM  ANALYSIS 

CAPABILITIES  (APPLICABLE  TO  CONTINUOUS,  DISCRETE  AND  HYBRID 
SYSTEMS) 


Classical  Tools 

Root  Locus 
Bode  Plots 
Nyquist  Plots 
Nichols  Plots 

Modern  Tools 

Optimal  Control  Design,  Discrete  and  Continuous 
Optimal  Filter  Design,  Discrete  and  Continuous 
Frequency-Shaped  LQG  Design 
Singular-Value  Decomposition  of  the  Return 
Difference 

Eigensystem  Decompositions  Including  the  Jordan 
Canonical  Form 
Model  Following  Control 
Model  Reduction 

Linearization  of  Nonlinear  Systems 
Minimal  Realization  and  Kalman  Decomposition 
Geometric  Control  Algorithms 
Multivariable  Nyquist  Plots 


Extensions  to  LQG  methods  require  inclusion  of  the  dynamics  of  the 
reference  inputs,  disturbances,  sensors,  and  actuators.  Appending  dynamics 
in  frequency-shaped  control  design  or  model-following  techniques  involves 
forming  augmented  equations  This  is  easily  accomplished  with  MATRIX^ 
primitives.  Use  of  frequency-shaped  cost  functionals,  with  singular  value 
plots  for  robustness  evaluation,  allow  incorporation  of  engineering  judgment 
in  control  design. 


Evaluation  tools  for  linear  systems  include  frequency  response  and 
power  spectral  density  plots,  time  responses,  and  determination  of 
transmission  zeros.  The  principal  vector  algorithm  (PVA)  primitive  for 


numerically  reliable  extraction  of  the  Jordan  Form  (with  discriminatory  rank 
deflation  of  root  clusters)  us  useful  in  modal  analysis.  PVA  enables 
computation  of  residues  or  partial  fraction  expansions  of  multivariable 
systems.  Some  of  these  capabilities  are  listed  in  Table  3_1 • 

MATRIX^  also  provides  capabilities  to  transform  models  from  any  one  of 
the  following  forms  to  another: 

(i)  Discrete  or  sampled  data 

(ii)  Continuous 

(iii)  State  space  including  various  canonical  forms 

(iv)  Transfer  functions 

(v)  Poles,  zeros,  and  gains. 


Interactive  Model  Building  (SYSTEM  BUILD) 


The  interactive  model  building  facility  called  SYSTEM_BUILD  is  a  tool 
for  building  models  of  complex  systems  for  use  in  simulation,  control 
design,  and  trade-off  studies.  The  user  can  develop  multi-input/multi¬ 
output  (MI MO)  system  models  from  models  of  individual  parts  of  the  system. 
Transfer  function  descriptions  can  be  combined  with  nonlinear  functions  and 
state-space  models.  It  is  also  possible  to  connect  an  externally  defined 
FORTRAN  module  to  models  defined  in  S  YSTEM_BUILD .  Models  can  be  placed  in 
catalogs  for  future  use.  Systems  defined  using  SYSTEM_BUILD  can  be 
linearized  and  simulated  with  arbitrary  inputs.  Modules  or  parts  can  be 
changed  or  replaced  without  recompiling  and  relinking  FORTRAN  code. 

A  hierarchical  structure  allows  models  to  be  developed  "top-down"  or 
"bottom-up."  In  the  top-down  approach,  the  designer  specifies  an  overall 
system  in  terms  of  its  major  subsystems.  Each  major  subsystem  can  be 
defined  as  an  interacting  interconnection  of  lower  level  subsystems.  The 
lowest  level  subsystems  are  finally  specified  using  basic  elements,  which 
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might  consist  of  nonlinearities,  table  look-ups,  transfer  functions,  state- 
space  models,  and  summing  junctions.  Nonlinearities  can  include  saturation, 
absolute  values,  hysteresis,  general  piecewise  linear  f unct ions- quanti zation 
and  general  algebraic  nonlinearities.  Transfer  functions  can  be  written  as 
numerator/denominator  polynomial  coefficients,  zeros/poles,  or  natural 
frequencies  and  damping  ratios. 

In  the  bottom-up  building  approach,  the  lowest  subsystem  models  are 
developed  first.  Major  subsystem  and  complete  system  models  may  then  be 
assembled  from  lower-level  system  models. 

Figure  3~2  shows  the  example  of  an  automobile  cruise  control  model 
developed  under  S YSTEM_BUILD . 


Figure  3-2.  MATRIX  and  SYSTEM_BUILD  Block-Diagram  Model  of  Cruise  Control 
System  for  an  Automobile  (the  figure  shows  actual  screen) 


Simulation  and  Analysis 

MATRIX^  provides  capabilities  for  •ificien*'  linear  and  nonlinear 
simulation.  Linear  simulation  is  performed  using  a  discrete  representation 
and  is  structured  to  fully  use  spsrseness  in  system  matrices. 

Table  3”2  shows  the  classes  of  systems  treated  within  MATRIX^  Table 
3-3  shows  the  simulation  and  analysis  capabilities. 

A  variety  of  integration  algorithms  is  available  for  dealing  with 
various  classes  of  simulation  models  (Table  3-iJ). 


TABLE  3-2.  CLASSES  OF  SYSTEMS  COVERED  BY  SYSTEM  BUILD 


Linear 
Nonl inear 
Continuous 

Single-Rate  Discrete 
Multi-Rate  Discrete 
Single-Rate  Hybrid 
Multi-Rate  Hybrid 


TABLE  3-3.  SIMULATION  AND  ANALYSIS  CAPABILITIES 


Simulate  general  nonlinear  continuous  models 
Simulate  general  nonlinear  discrete  models 
Simulate  general  nonlinear  multi-rate  models 
Simulate  general  nonlinear  hybrid  multi-rate  models 
Simulate  to  show  transitions  due  to  sampling 
Study  sampling  and  intersample  behavior  of  hybrid  and 
multi-rate  system 

Linearize  nonlinear  continuous  models  about  initial 
conditions 

Linearize  nonlinear  continuous  models  ft  a  point  along 
the  trajectory 

Linearize  nonlinear  discrete  models  about  initial 
conditions  (single  sample  rate) 

Linearize  nonlinear  discrete  models  at  a  point  along 
the  trajectory 


TABLE  3-4 .  INTEGRATION  ALGORITHMS  AVAILABLE  IN  MATRIX 


Euler  -  Euler 

Rk2  -  Rungc-Kutta  f2nd  order) 

Rk4  -  Runge-Kutta  (4th  order) 

Kutta-Merson  (fixed  step) 

Kutta-Merson  (variable  step) 

DASSL  -  implicit  stiff  predictor-corrector 


3.2  REAL-TIME  PROCESSORS:  MAX  100 


ISI  has  developed  a  system  called  MAX-100  for  testing  control  laws  in 
the  laboratory.  MAX-100  uses  a  multiprocessor  configuration  to  emulate 
nonlinear  control  laws.  The  r<-al-time  programming  requirements  are 
minimized  by  using  off-line  design  system  MATRIX^,  to  specify  the  control 
laws.  MAX  100  uses  the  Intel  80286/28?  and  8086/87  processors. 


The  proposed  prototype  can  use  the  experience  gained  in  MAX-100 
development  directly.  To  gain  high  speed  and  flexibility,  we  are  now 
proposing  use  of  Multiplier  ladder  ch.'ps  rather  than  the  standard  micro¬ 
processors  used  in  MAX-100.  Research  and  development  will  also  make  it 
possible  to  develop  a  high  speed  control  processor  board  for  use  in  flight 
testing  and  prototype  system  development. 


3.2.1  MAX  100  Real  Time  Control  and  Data  Acquisition  System 

Description:  MAX-100  is  a  high  performance  real-time  control 
implementation  and  data  acquisition  system.  It  provides  the  ability  to 
perform  nonlinear  real-time  control,  on-line  system  identification  and  data 
acquisition  as  well  as  digital  signal  processing.  It  can  be  connected  with 
ISI’s  control  design  and  modeling  software  package,  MATRIX^,  for  control  law 
design  and  downloading  of  control  logic  It  also  can  be  run  as  a  standalone 
system  for  field  use. 
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MAX-100  provides  ?  vital  link  in  the  control  design  cycle  for 
prototyping  non-linear  control  laws  with  switching  logic  and  adaptive 
control.  A  data  acquisition  facility  is  provided  to  debug  control  logic  fc 
off-line  identification  of  model  equations. 

Equipped  with  two  general  purpose  processors  and  two  additional 
arithmetic  floating  point  coprocessors,  MAX-100  performs  parallel 
computations  for  high  real-time  throughput.  Baseline  MAX  100  configura¬ 
tions  handles  16  analog  measurements  while  generating  8  analog  control 
signals.  Options  allow  expansions  to  32  analog  measurements  and  ’6  control 
signals. 

MAX-100  derives  its  name  from  MATRIX^  Architecture  Executive,  because 
it  implements  MATRIX  run  time  library  for  real-time  use. 

A 

FEATURES: 

•  Nonlinear  block  diagrams  mapped  into  a  multiprocessor 

implementation 

•  32-bit  IEEE-standard  floating  point  arithmetic 

•  Graphical  block  diagram  specification,  editing,  simulation  and 
analysis  in  MATRIX^  System_Build 

•  Push-button  simplicity  in  implementation  of  control  logic. 

•  Data  acquisition  and  storage  concurrently  with  real-time  control. 

•  On-line  identification  with  linear  and  nonlinear  models. 

•  Adaptive  control  and  fault  detection  capabilities. 

•  Multi-rate  control  implementation  feature. 


A  High  Productivity  Tool 


The  most  remarkable  aspect  of  MAX  100  is  the  ease  of  use.  For  example, 
a  graphical  block  diagram  for  a  nonlinear  control  law  (using  the 
System_Build  feature  of  ISI's  MATRIX^  design  software)  can  be  implemented 
directly  on  the  MAX-100.  Typically  prior  knowledge  and  physical  laws  are 
used  to  generate  a  mathematical  model  of  the  plant  in  System_Build .  How¬ 
ever,  MAX-100  can  perform  data  acquisition  and  on  line  identification  to 
refine  parameters  of  such  a  nonlinear  model.  Frequency  domain  methods, 
based  on  spectrum  analysis,  or  time  domain  methods,  based  on  parametric 
estimation  methods,  are  available  identification  methodologies. 

The  refined  model  can  be  used  for  performing  control  synthesis  and 
analysis  in  MATRIX^.  Once  a  satisfactory  discrete-time  control  law  is 
snythsized  and  simulated  in  MATRIX^  with  System_Build  it  can  be  implemented 
in  MAX  100  with  push-button  simplicity.  This  control  law  can  be  nonlinear, 
have  multiple  sample  rates  and  can  be  ultimately  targeted  to  run  on  many 
processors . 

MAX-100  handles  such  multi-rate  control  laws  accurately.  It  handles 
sampling  of  signals  and  updating  of  outputs  precisely  in  time  without 
inserting  any  undersirable  pipe-line  delays  or  scheduling  delays.  It 
maintains  synchronization  and  sharing  of  data  among  subsystems  running  at 
different  rates  without  inserting  any  anaccounted  delays  which  can 
deteriorate  phase  margins  in  control  loops. 

MAX- 100  removes  the  burden  of  writing  real-time  code  for  control 
implementation  and  testing.  It  provides  a  highly  reliable  tool  real-time 
control  integrated  with  the  design  and  simulation  software. 

Senef i ts 

•  A  reliable  tool  for  real-time  control  implementation,  prototyping 
and  testing. 

•  An  implementation  tool  integrated  with  design  and  simulation  tools 
to  provide  a  comolete  control  design  laboratory. 
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•  Multirate  architecture  implemented  as  multi  processor  multi-tasking 
system  for  maximum  throughput  without  inserting  pipeline  delays 
and  attendant  phase  legs, 

•  Powerful  control  logic  timing  and  debugging  feature ._ 

•  Useful  in  the  laboratory  as  well  as  in  the  field  for  control  law 
timing  and  debugging. 

•  Common  data  base  for  real-time  control  implementation  and  off-line 
simulation  to  minimize  potential  for  error. 


3  3  FUNDED  WORK 


Five  current  projects  are  related  to  adaptive  and  nonlinear  control 
implementation  and  associated  control  design  CAE  capability,  discussed  in 
this  report. 


Computer-Aided  Design  Methods  for  Engineering  Analysis  (National 
Science  Foundation):  The  project  is  studying  advanced  numerical 
algorithms,  hardware,  software  architectures  to  bring  advanced 
mathematical  research  to  a  working  engineer.  A  prototype  workstation 
based  on  an  IBM  PC  will  be  completed  around  March  1985 

Automatic  Real-Time  Code  Generation  in  Ada  (Air  Force  Rocket  Propulsion 
Laboratory) :  This  project  will  lead  to  a  capability  for  generating 
real-time  Ada  codes  for  control  implementation  once  the  control  law  has 
been  specified  using  MATRIX  .  The  code  is  written  i  Ada  and  will  be 
portable  to  all  imbedded  processors  with  Ada  compilers 

Hardware  for  Control  Implementation  (AMCCOM):  This  project  is 
developing  a  hardware  system  to  allow  automatic  implementation  of 
MATRIX  designed  control  laws  for  real-time  laboratory  testing.  The 
prototype  will  be  ready  in  January  1985  and  will  be  tested  on  a 
helicopter  based  gun  turret. 

Computer-Aided  Design  Methods  for  Optimization  (Air  Force  Armament 
Laboratory) ;  ISI  is  studying  the  feasibility  of  trajectory 
optimization  for  missile  systems.  This  capability  will  be  provided 
interactively  in  conjunction  with  the  MATRIX^  SYSTEM_BUILD  feature. 
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Engineering  Workstations  for  Distributed  Parameter  Systems  '’National 


study  was  done  to  develop  distributed  CAE  workstations  for  modal 
testing  and  comparison  of  modal  test  data  against  finite  element 
models . 
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Section  4 

POTENTIAL  APPLICATIONS 


The  adaptive  and  nonlinear  control  implementation  hardware  which  would 
result  from  a  successful  Phase  II  would  have  major  uses  in  commercial  as 
well  as  Federal  Government  applications. 

Commercial  Applications 


Advanced  control  methods  are  needed  in  chemical  process  control,  robot 
control  and  design  of  fast  robots,  engine  and  suspension  system  control  in 
automotive  industry,  and  servo  controllers  in  computer  disc  drive  design. 
Many  new  applications  will  occur  as  improved  CAE  tools  become  available  and 
the  designed  control  laws  can  be  rapidly  verified  in  the  laboratory.  The 
proposed  hardware  will  be  capable  of  implementing  optimal  trajectories 
allowing  more  economical  operation  of  process  plants  and  automated 
manufacturing  lines. 

For  example,  the  introduction  of  control  design  technology  into  the 
commercial  environment  has  been  slowed  by  the  unavailability  of  easy  to  use 
Computer-Aided  Control  System  Design  (CACSD)  tools  Hardware  implementa¬ 
tions,  refinements  and  tuning  of  selected  control  approaches  are  also 

x 

hindered  by  the  current  need  for  real-time  programming.  Prior  experience  in 
paper  mills  and  chemical  plants  has  shown  a  two  to  three  year  time  lag  and 
10-20  manyears  of  effort  to  implement  and  use  a  new  control  approach.  The 
proposed  products  will  reduce  the  development  time  of  such  systems  to  a  f ew 
months . 

Analysis  using  MATRIX^  has  shown  that  paper  mills  could  have  saved 
$768,000  in  just  one  year's  fuel  costs  if  adaptive  c-i.ii  nonlinear  control 
were  continuously  optimizing  the  use  of  recovery  furnaces.  Process  control 
systems  represent  a  $180  billion  per  year  market.  Most  power  plants  control 
systems  are  over  twenty  years  old  and  need  to  be  replaced  in  this  age  of 
scarce  resources. 
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Federal  Systems 


The  principal  results  of  developing  a  turnkey  control  implementation 
hardware  will  be  lowered  engineering  costs,  higher  performance--,  and  more 
rapid  deployment  of  complex  weapons  systems  new  aircraft,  complex 
transportation  systems,  and  satellite  communications  systems.  Advanced 
control,  guidance  and  estimation  methods  can  then  be  introduced  into  opera 
tional  systems  more  rapidly  since  development  times  and  risks  will  be 
reduced.  Easy  to  use  laboratory  test  tools  may  eventually  change 
policymakers'  decisions  on  appropriate  funding  levels  for  new  complex 
systems  development. 

Advanced  control  will  also  lead  to  better  weapon  systems  In  many 
cases  complex  hardware  will  be  replaced  by  simpler  hardware  coupled  with 
advanced  control.  For  example,  the  application  of  advanced  guidance 
technology  can  extend  certain  missile  performance  by  100?  without  any  extra 
fuel  or  hardware  cost.  New  weapon  systems  like  the  advanced  tactical 
fighter  are  so  complex  that  stability,  optimal  performance  and 
synchronization  of  various  control  features  will  be  feasible  only  with 
advanced  software. 
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APPENDIX  A 


An  Input-Output  View  of  Robustness  in  Adaptive  Control 
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An  Input  Output  View  of  Robustness  in  Adaptive 
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1  INTRODl  CTION 

At  avfrx  basic  level.  the  issues  involved  in  adaptive 
control  design  arc  no  different  from  nonadaptivc 
(robust  I  control  design  In  either  case  the  coal  is  to 
maintain  specified  performance  properties  despite 
uncertainty  about  the  dv  namics  of  the  plant  to  be 
controlled,  as  well  as  uncertainty  about  its 
environment  In  the  nonadaptive  case  the  problem 
of  robustness  to  unmodeled  dynamics  is  well 
formulated  le  e  Doyle  and  Stem.  1981 :  Zames  and 
Francis.  19x3 1  However,  research  in  adaptive 
control  theory  has  focused  almost  exclusively  on  the 
case  where  the  plant  cun  be  fully  represented  by 
some  member  of  a  family  of  linear  finite- 
dimension  ;  parametric  models  te  g  Narendra.  Lin 
and  Valuvam.  I9K0.  Goodwin.  Ramadge  and 
Caines  I9X<>|  Thus,  the  model  error  due  to 
unmodclcd  dynamics  is  presumed  to  be  zero. 
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I'nlortunately.  unmodeled  dynamics  call  cause 
adaptive  controlleis  to  exhibit  sigr.iiicanl  pci  Ini - 
ntance  degradation  and  instabilitv.  even  with  an 
initial  coni  toilet  paiametei i/ation  tli.it  Joselv 
appioximates  the  dcsiied  closed-loop  response 
(Rohis  and  co-vvorkcis.  19S1.  19x2.  loannou  ant) 
Kokotov  it .  19.x3a.bl  These  simulated  circumstances 
of  undesirable  behavioi  ;ne  in  sharp  contrast  with 
successful  applications  of  adaptive  control  where 
reduced-order  modeling  is  unav  oidablc  ie  g  Vstmm. 
I9S3 1  This  issue  of  model  error,  then,  it  of  undeniable 
practical  importance,  because  noactual  plant  istrtily 
linear  and  finite-dimensional 

Perhaps  the  main  reason  foi  the  lack  of  a 
robust  adaptive  control  theory  is  that  the  emphasis 
has  been  on  global  results.  What  we  mean  by  'global' 
is  that  the  intent  is  to  require  as  little  a  prion 
information  about  the  plant  paramemzalion  and 
the  external  inputs  as  possible  to  prove  stable 
bchav  lor.  Because  of  this,  the  resulting  requirements 
(i.e.  assumptions)  arc  too  strong,  e  g  known  plant 
order.  Therefore,  il  is  compelling  to  abandon  the 
requirement  of  global  stability  —  a  requirement  that 
may  well  be  beyond  the  needs  of  most  actual 
systems  -  and  develop  conditions  for  hna!  stability. 
The  term  'local'  is  used  in  the  sense  that  the  plant 
uncertainty  and  external  inputs  are  limited  in  a 
defined  way.  e.g.  by  restricting  the  magnitude  and 
spectrum  of  the  reference  commands  and  disturb¬ 
ances.  as  well  as  the  initial  adaptive  parameter  error. 

In  this  paper  we  will  present  an  input  output 
views  of  robustness  in  adaptive  control.  In 
particular,  we  shall  draw  attention  to  uncertain 
unmodeled  plant  dynamics  often  referred  to  as 
model  crroi  and  to  uncertain,  but  bounded, 
disturbances  Based  on  this  view  it  may  be  possible 
to  mcigc  robust  contiol  theory  with  adaptive 
control  theory 

The  nevt  section  (Section  2t  formalizes  the 
convulsion  of  a  genet k  adaptive  conliollei  to  an 
equivalent  genetic  emit  system  The  input  output 
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where  I'trit  K"  i>  the  error  output,  n  me  /?"  is  the 
esternal  input,  and  -gf?"  is  a  set  of  controller 
parameter  ts'  he  selected  For  our  purposes.  H,.,A\ 
representsa closed-loopparametricfeedhuek  system 
dependent  on  the  adjustable  parameters  in  n.  The 
output  c  of  H,  j-|  ii  the  error  the  control  system 
experiences  in  meet  inp  its  objective  given  the  external 
input  it.  Portion*  of  H,  „  l  )  are  not  entirely  known, 
eg.  the  open-loop  plant  imbedded  in  H,.„(  ).  The 
input  iv(i)  is  also  not  entirely  known  but  can  be 
assuhied  to  be  in  a  subset  M  of  bounded  signals.  For 
example.  n(M  can  consist  of  a  set  of  reference 
commands  and  bounded  disturbances.  If  the 
imbedded  controller  were  adaptive,  it  would  adjust  r, 
continuously  on-line  so  as  to  reduce  the  error ;  but  for 
now  assume  rhat  n  is  constant  and  w  ill  be  selected  off¬ 
line 

If  the  control  designer  had  all  the  off-line’  lime  in 
the  world  to  ‘fiddle'  with  the  parameters  n.  then  it  is 
hoped  that  a  satisfactory  adjustment  would  be 
obtained  Many  strategies  can  be  envisioned  for 
determining  a  satisfactory  n.  In  fact,  such  a 
satisfactory  parameterization  max  not  be  unique 
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Mtih  In-il  Is  i  X  lis  iii'ie  the  matched  p.n.imelei 
set.  i  e 

•V  R  ,11., ,tr  i  o;  I’,  i 

Rnbi<\i  1  el  V  denote  the  iobii'1  p.n.imelei  sel. 
i  e 

.S'"-  t'r".  R "  i  r  in  .i  i  /•".  v  hi  |.  II  ; 

(4.i  i 

wheic  the  norm  |  ,  i'  defined  on  the  undcilying 
hmeinni  sp.iee  The  finite  constant  />''  repiesent'  tile 
robust  performanee  specification.  Note  that  .V 
includes  the  'opiimaF  robust  siilutuiu.  i.e  those 
r.  e  R' '  that  solve 

infsup (i!W,„ir h> !  |av|i|.  (4bi 

It  »* 

Twwil  Let  S*,  ,  denote  the  tuned  parameter  sel 
associated  Mith  a  particular  n(  |e  II.  i.e. 

S*, ,  =  ; 7t*(  ,e  R"-\\H,.,jr.t,,  ,|itl'  i.  <  p*;.  (5a  i 

The  finite  constan*  p*  represents  a  tuned  perfor¬ 
mance  specification.  In  order  for  <4|  and  (5a)  to  he 
meaningful,  it  is  necessary  that 

p*  <  p"  (5b  I 

i.e.  the  desired  tuned  performance  is  better  than  the 
desired  robust  performance.  Also.  SI,.,  will  include 
the ‘optimal"  tuned  solution,  i.e.  for  each  we  W.  those 
7te  R "*  that  solve 

inf  (|]tf,  j7T  |n|  |hv|:  |.  (5c  I 

Ideally,  the  adaptive  control  should  converge  to  the 
optimal  parametrization  of  (5c).  Thus,  the  tuned 
parameter  sel.  denoted  by  S*.  is  given  by 

S*  =  (J  SI, (fit 

mi  m  H 

Note  that  each  element  of  S*  is  satisfactory  for  a 
particular  w(  )e  IV  and  that  no  one  clement  in  the 
subset  .S'l, ,  c  S*  need  provide  satisfactory  control 
fora  different  w(  )  (Although  n*,  ,e  S*  emphatically 
denotes  the  dependence  of  the  tuned  parameters  on 
iv(  (.  we  w  ill  henceforth  denote  membership  in  .V*  by 
the  simplci  notation  n*eS*.  where  the  w(  l 
dependence  is  to  he  implied  I 

The  error  signal  corresponding  to  the  matched 
case  is  identically  zero  ll  is  this  particular  case  that 
has  received  practically  all  the  attention  in  adaptive 
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expci  t.  ilk'll  opviaioi  lluis.  ilk-  immcasmahlc 
hounded  il kl in  h.i ik i*'  alluded  in  above  li.ivi'  llk'ii 
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"T 111-  iiimv  appealing  of  the  oilivi  two  svis  is  i lie 
liinvil  set  .V.  deli nvil  in  (('I  Ihv  associated  crior 

MtMl.il 

i  *  -  //,  Jr*  |u  (7 1 

is  rcfvnvil  lo  ns  thv  unit'll  error  and  H ir*l  as  the 
timed  s i ' win  Although  i  *ii  I  =  0  is  ruled  out  due  to 
the  impractie.ihtv  of  c  .V  we  do  not  preclude  the 
ease  wherei  ’n  i  —  0.  This  latter  ease  still  presumes  a 
decree  of  idealization  Consider  the  ease  where  the 
external  input  n  consists  of  a  step  reference 
command  with  no  disturbance  and  c*  is  the 
difference  between  the  plant  output  and  the 
reference  command.  Thus.  <•*(/)  — •  0  is  the  ideal 
output  error  for  anv  stabilizing  controller  engender¬ 
ing  unit  d.e.  gain  This  class  of  tuned  controllers  can 
be  quite  large  even  if  dim  (r*)<dim  (r).  Now 
consider  the  impact  of  a  bounded  disturbance, 
which  is  not  necessariK  of  anv  particular  functional 
form,  such  as  a  broadband  bounded  signal  Clearlv. 
with  such  bounded  disturbances  present.  t’*(f  I  —  0. 
and  can  onl>  be  assumed  to  be  bounded 

An  important  comparison  for  the  tuned  set  S*  is 
to  the  robust  set  S"  (4|  Let 

e"  =  W1.„(7T,I|H  (8) 

denote  thv  rnlvisi  error.  Recall  from  (5 1  and  (6 1  that 
the  tuned  parameters  n*  are  dependent  on  a 
particular  w  (  K  H.  whereas  the  robust  parameters 
r1  ate  not  Hence,  the  tuned  error  can  never  exceed 
the  robust  crioi.  i.e  foi  a  particular  )e  H. 

Ii.*f  -  |.//.jn‘h»|;  -  |i<’**ji  =  II//.  jn" |.v|l  (9) 

C  ondition  (9|also  follows  from  the  fact  that  p*  <  p" 
l^b)  Note  that  it  is  possible  for  the  robust  set  5"  to 
be  cniptv  even  though  the  tuned  set  N*  is  not  If  S"  is 
not  emptv.  then  consideration  of  an  adaptive 
contiollvi  is  instilled  il  for  some  ‘huge'  subset  of 
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II  ilm  uviv  not  lliv  case,  then  a  lobtisi  contiollvi 
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at  tamable  tm  all  n  l  I*  It  .  si  me  ( III  1 1-  icq  mud  oitlv 
oiei  a  subscl  ol  II  Howeiei.  even  il  (|t»i  holds, 
adaptation  max  cause  the  enoi  dining  adaplalion 
Is'  bcci'llll’  l'  1 1  111'!  excessive  i'l  to  mill  I  ll  I  sc  exceed 
spi'ClIk'.lt  Il'Ils 

1  he  uscl  ul  ness  of  defining  the  tuned  paiamelei  set 
will  be  borne  out  in  the  next  subsection  1  lie  tuned 
set  is  used  there  to  dexelop  a  generic  adaptixc  erroi 
svsiem  At  this  point,  however,  we  remark  that  it  is 
nol  necessarv  to  solve  the  optimization  problem 
defined  implicitiv  in  (5|.  rather  we  onlv  need  to 
know  that  a  solution  exists  which  is  better  than  the 
robust  solution  (4 1 

(Bl  Adapt  it  e  error  system 

Now  consider  the  adaptive  version  of  (1). 
depicted  in  Fig.  2.  and  described  bv  the 
input  output  relations 

W.'jrfj  .. 

.  w  =  H(t:  I  ii  (llai 

/TJti)_ 

ft  =  n[ji(0k  c.  ;  j  (1  Ibi 


where  rtrie  R'n  are  the  adaptation  parameters  which 
are  generated  from  the  parameter  adaptit  e  alttoi  itluu 
f2.  and  r(0)e  R"~  is  the  initial  parameter  estimate. 
The  adaptive  algorithm  is  driven  bv  the  output  or 
adapt  at  ion  error  c(t  )€  R"'  and  the  regi  e. vsorjdc  R":. 
The  regressor  is  obiained  from  sensed  signals  w  iihin 
the  feedback  system. 

We  want  to  ultimatelv  determine  conditions 
under  which  the  adaptive  svstem  (III  is  stable 
attracted  to  the  set  of  tuned  systems  (6|  Recall  that 
the  tuned  system  set  is  likely  to  contain  more  than  a 
single  member,  thus  bv  stabili.v  we  mean  stabiluv 
‘about’  a  (possibly  disconnected)  set  rather  than 
about  a  point. 
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Noli-  tli.it  iliis  development  is  ik't  Imuii'il  to  SISO 
pi. ints  I  Ik  extension  nl  |I2i  to  ilk-  imilin.ii  i.ihli1 
case  niM'ki's  ,i  simil.ii  c\pi  I'ssii'ii  It  ii  each  contiol 
channel.  i  s' 

klfl  -  .  i  ’  i  r  l 1 1.  i  =  I .  ...  ii,  1 1  3 1 

mIk’Ii'  .in  .mil  ri.’i  .in’  v ccloi s  consisting  of 
elements  It  I'm  ilk'  teeressoi  .mil  parnmetei  \eetors. 
respectively .  Hoiii'ii'i.  i'lll \  ihe  SISO  case  will  he 
coiisiiieieil  heie  to  t educe  the  complexity  of  the 
deieli'pnieiit  and  alls'ii  sh.upei  fi'eiis  on  the 
adapnie  systems  issues  Normally.  cl/t  consists  of 
the  plant  inputs  and  outputs,  or  filtered  versions 
theieol  for  example,  in  discrete-time  systems  4(f) 
consists  of  a  finite  record  of  past  plant  inputs  and 
outputs. 

Although  the  bilinear  structure  in  ( 1 2 1  and  (13 1 
remains  the  most  widely  used  and  studied  format, 
nonetheless,  other  structures  (as  yet  underdevel¬ 
oped  i  may  he  more  suitable  to  certain  problems 
e.t.  distributed  and  or  nonlinear  structures. 

W  e  will  now  make  a  strong  assumption  regarding 
the  way  in  which  mi)  and  u(t)  are  transmitted 
through  Hi.)  into  ctri  and  4(f). 

Assumption.  The  map  (" .  i/ )  |  — *  (e.  2  I  is  linear  time- 
invariant  (LTI  i.  t  e 

fit)  _  G,J  s|  G.Js)  r  h  u  >1  _  r 
4(f)  G,„im  G.yIM_  [_m(I)J 

(14) 

where  G(')  is  the  open-loop  intenonneeiion  matrix 
whose  elements  are  proper  rational  functions.  (To 
simplify  notation  we  will  use  s  to  denote  either  the 
Laplace  transform  variable  or  the  differential 
operator,  depending  on  the  context.) 

The  adaptive  system  (II)  with  bilinear  control 
(13)  and  L.TI  interconnections  (14)  is  shown  in  Fig 
3  To  transform  this  system  to  an  error  system, 
define  the  pumnieter  error 

7T I M  =  ft  (i)  -  71*  (15a) 
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and  the  itdiipl ne  lonnol  enot 

ill)  =  .(it  3im  (K'i 


Thus.  Fig.  3  can  be  redrawn  as  shown  in  Fig.  4  and 
described  by 


where 


H*.Js)  =  G..JS)  +  Gru(sir*  (/  -  G.u(s|r* T  ’G.Jvi 

(ISbl 

H*,is)  ■-  G ,.„(>)  +  G..„(.s ITT*  (/  -f  G;u|s|r*T  'G;u(M 

( I  Sc  I 

W*Js)  =  (/  +  G;u(.s)7:*'r  'G4„(.s)  (ISdl 

{I  +  CoJs^T'G.Jsl  (ISel 

The  dashed  box  in  Fig  4  is  W*(c)  We  will  refer  to 
H{s)  as  the  tuned  interconnections.  Note  that  the 


tuned  error  (7)  is  identical  to 

e*(f|  =  H;js)  u(l).  (I9i 

We  also  make  use  of  the  tuned  regressor,  defined  as 

v*(f >  =  W*«(M  w(M  (20) 

Finally,  the  error  system  (Fig  4)  can  he  depicted  as 
in  Fig  5.  where 

e(t )  =  e*(f )  -  H*  (  s )  r(f  I  (21a  I 

s(l)  =  4*(f  I  -  H*ls)  t  in  (21b) 

r(f)  =  e(f)  n(f|  (21c) 

7t(f )  -  nijf(O).  <•(  i.  4(1)  ( 2 1  cl l 


K*  f  .V* 


(15b) 


I ii pul  i »u  1  pul  view  of  .nl.i pi i \ v  n'lilii'l 


S'  t 


1  i>  4  Adaptive  cnm  *.\>uni 


Figure  5  icveals  ih.it  this  trior  system  is  composed 
of  a  nonlinear  system  in  the  forwaid  loop,  denoted 
by  and  ihe  LTI  system  W*(s I  in  ilic  feedhaek 
path  Thus.  iheeiroi  system  isdnu'n  externally  by 
the  tuned  system  outputs  e*tr)  and  c%tM.  and  the 
initial  parameter  enor  rt<>i  =  r(0|  -  r*. 

if  l  £\o;</ki  c'  iln  tuned  i  ontroller 

The  designation  of  the  tuned  controller  is  the 
concept  most  important  to  extracting  a  meaningful 
error  system  from  the  description  of  an  adaptively 
controlled  sv  stent  It  might  appear  that  the  ability  to 
specif)  this  tuned  controller  presupposes  our 
knowledge  of  an  acceptable  solution  to  the 
underline  adaptive  control  problem  This  is  not 
entire!)  the  case  Given  the  parametric  controller 
struciure  of  f  i  i.  we  need  only  have  an  approximan 
a  prion  knowledge  of  the  system  behavior.  Given  a 
particular  r:*.  we  wili  discover  that  the  restrictions 
on  H*  and  H‘  can  be  assessed  from  knowledge  of 
the  tuned  controller  and  bounds  on  the  magnitude 
of  the  plant  modeling  error  Such  information  is  a 
practical  result  of  a  thorough  plant  modeling  studs. 
Thus,  the  study  of  the  stability  of  (21  I  will  have 


practical  meaningfulness  We  will  examine  a 
particular  continuous-time  adaptive  controller  in 
the  following  section  and  denv c  the  for  m  of  //*,  and 
//;, 

?  (  (IXTIXUll  S  HMl  ADM’TIVF  MODI  I 
1  DLL  OW  l\G 

To  characterize  H’,  and  H*  some  designation  of 
a  tuned  controller  must  be  provided  We  make  the 
choice  by  assuming  that  no  modeling  error  exists  in 
the  nominal  plant  parametric  model  W  e  close  with 
consideration  of  the  degree  of  plant  mismodeling 
allowed  such  that  this  tuned  controller  is  robust,  t.c 
maintains  stable  control  of  the  actual  svstem 
Following  this  discussion,  in  Section  4  we  consider 
the  effect  of  the  adaptive  algorithm. 

(A)  Direct  model  reference  adaptin'  control 

Consider  the  model  reference  adaptive  control 
(MRACl  svstem  shown  in  Fig  6.  described  by 

\{t )  =  d(t)  +  P(.v)u(f )  (plant)  (22a ) 

y(r|  =  /?(.v|r(i)  (reference  model )  (22bt 

c(i)  =  yd)  —  id)  (tracking  erron  ( 22c i 


I  it.  *  Adaptive  error  s>m<  in 


K  I  knsi  i  unJ  ('  R  Jiiiinsii\.  .Ih 


f  *  e  <  r  »-i  t  model 


(o) 


(D) 


Fu.  t  Model  rcfctcncc  adaptive  vwen.  ia>  hLs.1.  tbi  vomrollct  dc’.a,’. 


where  dirt  consists  of  disturbances  and  plant  initial 
conditions,  and  r(i)  is  the  reference  command  Lei 
{Ot.fi!  denote  the  adaptive  controller,  where  fi 
is  the  parameter  adaptive  algorithm  and  C(  I  is  the 
parametric  controller.  Following  Narendra.  Lin. 
and  Yalavani  (1980).  let  O  I  have  the  bilinear  form 


where  the  tuned  parametri7ation  r*(  =  r-ri  i-. 
disiribuied  among  ihe  control  elements  as  follows: 

-4 1 < s l  =  nfs1' 1  -  ...  -r  r*  (25a t 

A*i' l  =  n*.  ,s‘"  1  -  . . .  ■+  rik  (25b I 

AUs\  =  ,s4' 1  -  ...  4  (25c t 


util  =  -cdirtn 

=  -gu(M  ru(t|  -  '.(D  rjt)  -  ir(n'JT,(r)  (23a) 

where  the  regressor  is  given  by  filtered  versions  of  u. 
l  and  r 


41/)'  =  [ca(/)'.  c,(f )'.  {,(/)]’ 

=  [F(s|u(r|.  F(s|y((|.  -F(s)r(/|]  (23b) 


with 


F(x)  = 


j_  .^_'i 

L(s)  L(s)j 


and 


(23c) 


Ll'l=  s*  4  a | s‘  1  4  ...  +  at.  (23d) 


Thus.  (24)  becomes 


u\l)  =  Ots)  r(i )  -  C*(s|  y(  / 1  -  0(5)1(11  (26a) 

where 

0,(51  = 


At(sl 


0,(5)  = 


L(s)  4  ,4f(.M 

^;<s) 

L(5|  4  ^*?(  S )' 


L(s) 

C*  ( s)  - - 

L ( 5  I  4  /4  *  (  S  ) 


(26b) 


We  will  refer  to  C*  =  [Or-  O,-  O,  ]  as  the  tuned 
controller.  The  adaptive  error  system  (21)  cor¬ 
responding  to  the  MR  AC  of  Fig.  6  is  shown  in  Lig  5. 
The  tuned  signals  (3.19)  and  (3.20)  arc 


Thus,  there  arc  3 k  adaptive  parameters  Using  the 
definition  of  adaptive  control  error  in  (21c).  the 
MKAC  control  signal  (22)  can  be  expressed  as 


u(f  l  - 


AT(5| 
Li  5) 


u(/|- 


A*(s) 

L<5> 


id  I  4 


AH'I 

1.(5) 


/d)  -  t  d) 


(24) 


c*  =  [(I  4  pc;, )  1  PC*  -  H  j  r  -  (I  4  PCM  1 d 

(27a) 


4*  = 


(I  4  PCM  ’(*/  r  -  CM  I  4  PC'*  )  'Fd 

(i  4  pc;,i  1 pc;,/  >  -  (i  4  pc  ;, i  'r  d 


L-/> 


(27b) 


Input  output  xicxx  ol  .ul.iptai  inniu'l 
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III.  1  lined  intei . 
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1  1 
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!,  i  '  /•<  ; 

(2s.it 
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1 

1  /*< 

i  '<  :.i  1 

ir 

'l\ 

1  /*< 

i  '/’< ;,/  ! 

(2shi 

j  •  1 


I  H  I  Iwn.l  m  in  t  mill i>l  design 

1  lieie  .ik  any  nunthei  of  xxays  to  design  the  I  lined 
contioliei  (  *  The  impoit.mt  point  no  mallei 
xih.it  design  mcthoil  is  used  is  that  the  tuned 
design  must  he  lohitst.  heeatise  the  plant  Pm  in  (27) 
and  i  r 's  i  is  not  enln  elx  k  now  n  Recall  It  out  (5  I  that 
the  tuned  eonitollei  is  dependent  on  the  plant  I  or 
example,  the  3/,  paiameteis  in  r.'  cannot  make 
r  1  — •  i  in  i2~a  l  he  identical!)  zero  This  can  he  \  iewed 
as  a  reduced  ordet  design  problem  or.  as  in  the 
discussion  that  follows,  a  piohlcm  in  robustness  to 
unmodelcd  dx nanito 

Suppose  that  the  actual  plant  can  he  described  b> 
/>tv)  =  ;i  -  A(s|]P*tM  (29a) 


Ah...  ilu  let.  ten. .  niudil  1 1  .i  1 1  -  K  1 

lulu  I  l<  Ml  |s 

.IssIlUKtl  lu  1', 

/i|.|  l-.s"  ,  I..S-  '  . 

b 

f/M 

(  Ai  i  j 

1  1  -  1  s"  1  1/  |  1 

•  o. 

whole/’.  . ii,.  .  i/„  .n e  pi escle.  Us 

d  i  Ullst. lilt' 

and  xx  lieie  II M  is  ex ponenl  i.dlx-st.ihk 

i  e  all  /eius 

ol  -l i s )  ,ue  stiutly  uisnle  the  loll  hall  plane  ll  i-  well 
to  point  out  lieie  that  although  assumption  t2t 

ahoxe  can  he  satisfied  by  the  puiuni. 

.tiu  model 

(29hl.  this  is  not  the  ease  lot  the  .utual 

plant  l2v.i  i 

due  to  the  presence  ot  the  mist t  u.  t u i  ed 

un.ei  t.nnty 

(29.  i 

The  timed  contiollci  siiustiue  p 
L  g.udt  1 1  9“v  i  requues  that 

tupused  in 

R* 

(  *,  = 

(,  31a  l 

/.,,/P.x* 

HI  ' 

c;.  - 

(3  1  b  l 

/>,,«*. s* 

where  7*  is  a  stable  monte  polynomial  of  decree 
n,  >  n  -  m  -  1 .  and  w  here  the  poly  normals  .S'"  and 
R *  uniquely  solxe  the  polynomial  equation 

7*4  =■  R'  ~  AS'  (31c) 


/’„('"  *  h.s”"  1  -  ...  •*  hn\ 


where  P*M  is  a  mind  porainetrii  model  of  Pi s I.  t.e. 

the  parameters  t h,„  . .  hm.  u, . a„|  proxide  a  good 

fit.  sax  at  loxx  frequencies  The  transfer  function  A(.x| 
represents  unmodcled  dy  namics.  i.e  those  dx  namics 
in  Pi s i  not  accounted  for  by  P*(s|.  eg.  high 
frequency  eflorts  Assume  that  A(s)  is  stable  but  is 
otherwise  unknown  except  for  a  bound,  i.e. 

lAtjia):  <  dim).  Vmi  R  (29c) 

This  type  of  modeling  uncertainty  is  said  to  be 
unstrm  lured .  (Doyle  and  Stein.  I9M).  In  more 
general  terms.  (29)  provides  a  set  description  of  the 
plant  rather  than  a  single  parametric  model,  such  as 
P*  (Safonox.  I9X0|. 

We  will  now  examine  the  impact  of  model  error 
on  a  tuned  com  ml  design  based  only  on  the 
parametric  model  The  model  reference  format 
suggests  that  wc  make  e*  as  small  as  possible.  To 
eliminate  the  tracking  error  term  in  (29a  I  entirely, 
we  will  use  the  procedure  described  in  Egardl 
(197V),  which  requires  that  the  following  infor¬ 
mation  is  known 

(I  I  n  >  ni  (P*(\|  is  strictly  proper) 

(2 1  n  and  m  sue  know n 

(3)  «*(s|  has  all  zeros  strictly  inside  the  left  half 
plane 


w  ith  S*  monic  of  degree  ii,.  and  R'  of  degree  n  -  I. 
With  no  model  error  (A  =  ()|.  this  controller  (31 1,  in 
addition  to  stabilizing  the  tuned  system,  also  makes 
the  transfer  function  from  r  into  i*  identical  to  the 
reference  model  WM  Thus,  the  tuning  of  (31 )  is  for 
the  subset  of  H  composed  of  bounded  reference 
signals  and  zero  disturbance  The  effect  of  1 3 1  Ion  C* 
will  shortly  be  made  apparent  C  omparing  (33)  with 
(26)  mottxates  solving  for  n*  from 

L  4  A*  =  B'S * 

AX  =  -  R*  (32) 

o,. 

AX  =  -  BT* 

hc 


k  =  n,  ■+■  m  >  n.  (33 ) 

With  this  choice  for  M*.  ,4*.  .4*1.  the  tuned 
controller  is  gixen  by  (31  )  and  by 


C*  - 


B.S* 


(34) 


(C)  The  cflat  ol  model  emu  on  timed  system 
pcrfnrmniH  «• 

ll  is  conxcnicnt  to  define  the  transfer  function 


a 


R * 
7*1 


(35) 


A  solution  for  r*  exists  proxided  that 


.  c.  »*.  c-  C--o_  — c — -l. 


K  I  Ki'si  i  and  <  K  .!  (  m  i  nm  in.  In 


l  Mill'  I  III  I  nil,  it  v  i  >1)1  I  .  'Ill  l  1 1  Isl  ill'll  I  llvil  I  III  I  mil'll 
Mi'll. ll  I  2*’  I  .III  I  Ill'll 


il  '  \(.*l 

1 1  ■  \( . *  l 

■  it  •  A(.*  l 


I  VS* 

Nil  (.*!///  .  .1 

I  /  • 


(111) 


I  *  H  I  *  /\  * 

/  i  I  ,1 

/>,./<*  I  /•„/<*/•! 

H  S'  I* 

(I  ■  A i  /  /  I  ,1 

I  /  *  I 


I  ,'(>hi 


.nut  tin'  UiiK'il  mtciconncctions  (26|  become 


4  (  ,|  (  III  \|  N  I  Mill  I  I  V  l  (  INI  >1  I  |l  >\l 

I  hi-  pm  pi'ii  nl  I Im  h  i  iii'ii  1 1  In  mi  i  i'll ui i'  global 
siabilitv  ii'iiiiiiu'iii  .ipplii .i till-  ii>  ilk-  I'l'iiiiii  i'ii in 
i\  iii  in  of  I  2  I  I  I  n  l In-  pi  iH  il mi'  H  i  in'll  ii  i  ipn  ilii'il 

III)  illl.l  pi  I  \  f  i  i 'III  1 1 'III' I  Sl  I  111  I  III  l'  (  II  ll  i'll!  M  1 1 1 1 1 1  HI 

tlicn  developed  ilk-  iiiiii'il  system  |i .  i/i ,  -  ii  | 
mill  I  In-  inii'i  i  I'liiii'it  ii  <n  opi'i  .Mori  //*  .uni  //*  We 
non  need  ii>  chaiadei i/f  thi'  .id.ipiiii-  Ian  12  in 
(2ldi  W  uli  iliis  connection  \ii'  Mill  hi-  able  h> 
ink'ipii'l  sonii'  i'ii  nil  il  ions  u  n  ili'  i  which  such  a 
continuous-time  ailapinc  conti ollei  possesses  a 
( 1 1  m  1 1  i'ii  i  degi  ee  of  robustness  ()m  interpretive 
ii'iiiaiks  mil  adiln'ss  the  ri'sUiiini'iii'is  of  the  SPK 

ci'inlilii'ii  mi  77,*,  that  arises  in  plastically  all  global 
stability  theorems 


77*  =  1 1  -  A(>*  I  'll  4  A  l 


bj. 


7*1 

.4*2  1 


(37a  l 


"  +  '  77*7  *4  7 


77*  -- 


A(i*  I  ‘(I  -  A I  t  -  l 
7  .'1 


/>„£.  I.  (37b) 


The  tuned  system  with  no  model  error  (A  =  0 )  is 
e\ponenliall>  stable,  since.  by  assumption,  the  poles 
of  (B*  r  '.  (.4  r  ’.  and  ( T*  |" 1  are  in  (lie open  left  half 
plane.  Henee  <■*  and  e *  are  bounded  if  r  and  <7  are 
bounded.  Thus,  the  stability  of  the  actual  tuned 
system  is  guaranteed  if  and  onl>  if 


(1  ■+  AC7*I  1  and  (1  +  AG*!'  'A 

are  exponential!)  stable.  (36) 

Note  that  under  these  conditions,  the  tuned 
interconnections  in  (37b)  remain  exponential!) 
stable.  However.  it  is  not  necessars  (nor  possible  by 
assumption!  to  have  a  complete  description  of  A  in 
order  to  satisfy  (36 1.  For  example,  if  A  is  known  to  be 
exponential!)  stable,  then  Mith  0*  known  to  be 
exponential!)  stable.  (36)  holds  if  (e.g.  Doyle  and 
Stein.  1961 )' 


|A(j<'i)|'|(.*(jm);  <  I.  VmrTT  (39) 

Satisfaction  of  (39)  requires  that 


(.4)  7  he  adaptne  algorithm 

We  Mill  begin  by  specifying  the  adaptive  laM(s)of 
interest  A  huge  class  of  adaptive  algorithms  ( 2 1  d  I 
have  the  from 


f.  (M  =  .4  [;(•).  oi(/ 1  ".  )i(Oie  Rr  (41  a  I 
<•>(/)  =  c(M  <’( r |.  (4 1  b | 

We  w  ill  refer  to  ,4(.. .  I  as  the  adaptation  gum.  which  is 
a  nonlinear  operator.  In  general  .4  .  ]  can  have 
memory,  usually  only  in  2(M.  The  adaptive 
algorithm  can  also  be  expressed  in  terms  of  the 
parameter  error  7t(M  as 

77  (/)  =  .4  [  j(-).  W(M].  77(0 1  =  77(0  I  -  77*.  (42) 

The  complete  adaptive  error  sy  stem  (21 ).  including 
the  adaptive  algorithm  (42).  is  shoMn  in  Fig.  7. 

The  choice  of  algorithms,  i.e.  the  variety  of 
proposed  adaptation  gains,  is  virtually  unlimited. 
The  following  two  are  our  chosen  representatives: 

Constant  gam  (Narendra.  Lin.  and  Valavam.  1 980 1. 

A  [<;(•),  <u(r|]  =  .4o<v>(M  ,,, 

(4)  ) 

where  7?r ' r.  ,4,,  =■  .4,,  >  0. 

Retarded  gain  (Kreisselmeier  and  Narendra.  1962 1 


A  [{(•).  cut)] 

_  f.4(1<  j(r).  |ri(01  <  c 

(/4<,i«'7(f)  -  (I  -  |7T(t)|  (  |:77(f)].  |77(ll  >  l 

(44  1 


|A(i<  i)i  <  £(»•»)  =  1  VmR.  (40) 

We  Mill  show  in  Section  4  that  7>(<’M  <  I  is  the  limit 
imposed  on  <’>(<•<►  by  the  usual  global  stability  results 
for  continuous-time  adaptive  systems  Similar  limits 
are  also  encountered  Mith  discrete-time  adaptive 
sv  stems 


where  4,,e  Rr‘  A„  =■  A‘„  >  0.  and  i  >  max  Ir*. 

We  Mill  use  the  concept  of  persistent  excitation 
that  has  proven  important  in  adaptive  control,  as 
well  as  in  adaptive  system  identification 

Definition  (Anderson.  1977 1  A  function 
f(  |  R.  K"  is  persistent l\  esiiliny.  denoted  by 


t.i  PL.  il  tlieic  exists  positive  const. mts  7 :  and  y  ,  and  tlicic  exists  a  finite  constant  r  ti  sticli 

such  that  that 


j;/,.  >  |  f(t)  Hi  |  Jt  >  x,/„ .  v>e  A’. .  (45) 

We  will  discuss  the  implications  of  persistent 
excitation  on  global  stability  below,  as  well  as  in 
Section  5.  in  regard  to  local  stability 

(Bi  .4  global  stability  theorem 

Theorem  I.  which  follows,  gives  conditions  for 
global  stability  of  the  adaptive  error  system  of  Fig.  7. 
The  term  global'  refers  to  the  intention  of  seeking 
the  minimal  (reasonable!  restrictions  on  the  tuned 
signals  c*(ri  and  ;*(/).  and  the  tuned  interconnec¬ 
tions  W*  island  Hf,  (s)  resulting  in  the  proof  that  c 
and  c  remain  bounded,  ie.  (21 )  is  stable,  for  any  finite 
tf  (())'( A  detailed  proof  of  Theorem  I  is  given  in  Kosul 
and  Friedlandcr  (1983).)  In  particular,  we  will 
consider  the  following  tw  o  tuned  system  signal  sets  as 
'inputs'  to  the  error  system: 

IV*  =  Jr*,.;*.  n(0)|<-*.e*eL2nL,. 

f  e  Lr,  Rr\  (46) 
IV,*  =  |c*.(f*. n(())|«'* e  L, . c*  e  Lr, . 

?T((»)e  /?rJ.  (47) 

Note  that  <•*.  feLoL,  essentially  implies 
boundedness  and  ultimate  decay  to  zero,  whereas 
inclusion  in  L.  only  implies  boundedness 

Theorem  1  For  the  system  of  Fig.  7,  assume  that 

(Al)  Hr, is)  is  strictly  pioper  and  exponentially 
stable  (48) 

(A2)  //,*,( m  is  strictly  positive  real  (SPR),  ie 
//,*,(  s  >  is  strictly  proper, exponentially  stable. 


Re  H‘ . (.t « •  > i ’  >  / * | //,*, (J<’» Voir  u  j  i  (4^i 

Under  these  conditions,  algorithms  i4?i  or  (44 1 
result  in  the  following  properties: 

(D  If  i<  *.  c*.  ir(0)ie  IV*  then  r.  e.  and  i 
are  bounded  (in  L ,  ).  and 

e*U  I  -  ell  I  —  0.  In  addition,  if  e  PF..  then 
riM  —  0  exponentially. 

(ii )  If  (t  *.  ■*.  n (0  n c  M  J5  and  ;  e  PE.  then  f..  e. 
and  i  arc  bounded  (in  L,  |. 

(nil  If  |r*.  c*.  rr(0))e  IV,*  and  c  €  PE.  then  the 
results  of  (n)  still  follow  by  uMng  the  gain 
algorithm  (44  > 

Comments  on  Theorem  I.  Though  theoretically 
significant,  these  results  do  not  offer  the  engineering 
design  guidelines  we  would  like  to  obtain.  The 
major  reason  is  that  W*(s|eSPR  (condition  (,4;)| 
is  virtually  impossible  to  achieve  for  any  actual 
system  The  primary  culprit  here  is  the  eflect  of 
unmodeled  dynamics.  Details  on  this  issue  may  be 
found  in  Rohrs  and  co-workers  (1982)  Further 
discussion  will  be  provided  in  the  following 
subsection 

Another  technical  hurdle  is  that  the  only  realistic 
case,  insofar  as  the  tuned  signal'  (<•*.,:*)  are 
concerned,  is  when  (c*.c*|eli;  This  is  the 
situation  induced  by  continual  bounded  disturb¬ 
ances.  such  as  would  normally  be  encountered  But 
in  this  case  the  theory  requires  that  cither  c  e  PI  as  in 
part  (ii)  or  that  the  adaptation  gain  is  retarded  as  in 
part  (in )  With  bounded  disturbances  present  it  is  not 
know  n  how  to  guarantee  u  e  PL.  since  c  is  generated 
inside  the  adaptive  loop  Note  that  part  (i)  only 
requires  that  the  tuned  reg lessor  „;*  e  PI  rather  than 
the  actual  rcgrcssoi  ,.  *  PI  as  in  part  ( n )  Howevei. 
this  requires  (c*.  c  r  II  *.  which  is  only  possible  when 
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lln  n'liliol  si  i  in  lull*  pioiidv.  ,is\ mplolii  model 
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ll. iso.  ^.isj-  sin. Ik, I  in  | Ik-  liui.iiuu  (Mui.'iisls. 

iinm.uliliil  iImi.iiiiks  a i kI  bounded  disttu  bailees 
ehmm.iu  llns  ii(..  1 1  siln. ill. <n  \  luilliet  ilillunlli 
llf.lllllng  .  •  I ’I  Is  lll.l  |  I  Ills  III  s  .|1  the  expense  of 
an\  si-i-pninl  i c i_* 1 1 1 . 1 1 1 . * i i  ulneli  delei  i.n all's  in  1  lic 

pi  i  si' I  III  ,  >1  1*1  Sit'll. lls  l  slllt'  t'.llll  lll.llll.lll.il)  llofs 

iii »i  lupine  |visisuni  i'u ii. nii'ii.  Inn  lints  lequne 
s.'iiii-  ./  prim  i  mini  m. ill,  <n  it  as  in  (44 1.  the 
fi>i ik now ledge  til  an  tippet  h.iniul  on  |r*i.  ulneli  is 
ii*  >1  l  mi  ill)]  is  nil  liinlu.iin  Although  if  la  iila  linn  ilnfs 
h.niitlf  hniiiiilfil  ii ist ii i  ha iif f .  t lif  SI’K  fi'iulilion  is 
siill  required 

ll  I  I n  I’W  'iiti  i'l  ill .  SPK  <  mi./iiimi 

'It  lull  il  1)1,111  ID  ill,-  Mills. 

mil i  <i  /.<.>/  luoLs  i u  Ins  finder.' 

Annin  nimis 

The  intent  of  this  aphorism  is  lo  divert  am 
lingering  anxieties  about  the  SPR  condition.  It  the 
SPK  condition  simply  "ill  not  do  as  a  major 
building  hloek  in  adaptive  control  theory.  But  that 
does  not  mean  a  total  abandonment  of  our  aim:  it 
suggests.  rather,  a  redirection.  We  should  be 
establishing  a  different  patli  to  the  'stars  ’  For  now. 
however,  we  will  remain  eanhhound  and  address 
the  restrictneness  of  the  SPR  requirement. 

A  necessary  condition  for  H*,  €  SPR  is  that  H*  (s) 
have  a  relative  decree  of  one  As  pointed  out  by 
Rohrs  and  co-workers  ( 1^82 ).  this  imposes  the 
requirement  that  the  relative  decree  of  the  plant  ts 
known,  eg  examine  the  effect  on  the  plant  P  in 
(28a  i  This  knowledge,  however,  is  unavailable  due 
to  the  presence  of  unmodeled  dynamics,  as  assumed 
in  (29 1. 

The  same  type  of  restriction  can  also  be  seen  as 
follows.  From  (37a i 

H*  =  (1  -  AC*r  ’(I  +  A)H*  (50a) 


If  A  is  exponentially  stable,  but  is  otherwise 
unstructured,  then  conditions  for  H*  i:  SPR  include 
(kosut  and  Friedlander.  1983) 

( 1 )  ft*,  e  SPR  (51a) 

(2)  |A(jm )|  <  1.  (51b) 

Since  ft*,  is  dependent  only  on  the  parametric 
model  /’*.  it  is  not  difficult  to  find  n*  such  that 
H*  t  SPR  Unfortunately,  the  drawback  is  that 
(51b)  is  a  condition  that  is  almost  suicly  violated, 
due  to  typically  tiiimodcfcd  high  frequency  dy¬ 
namics 
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A 1 1 1 1  o  1 1  o  | )  .!  positive  loiisi.mt  i^.SPK  .uni  Iif  iii  f. 
satistifs  (Ml.  condition  (MI'I  is  still  i  c  i.)  tin  fit  tot 

//,*,  t  \HI|  to  he  SPK 

1  lifsf  disci. imicis  lf.nl  Us  .in. iy  horn  the  global 
appio.icli  is  pi  I  if  il  by  Iheoiem  I  !.•  tin  establish- 
niff) i  ol  loi.il  stability  iisiilts  wind:  .oc  i.ihiisi  lo 
unmodflfd  dvn. mins  and  hounded  disturbances 
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In  this  section  tie  indicate  a  means  ol  obtaining 
local  stability  conditions  locl.mlv  the  distinction 
between  local  and  global,  eoiisiilei.  lot  example, 
resiili  tni  ol  Theoiem  I  This  result  holds  if 
M*  eSPR.  II",  exponentially  stab’e.  u  *.  ,•*  p  11 
C€  PL.  and  rtUi  •  /  .  Aside  from  the  difficulties  in 

establishing  SPK  and  PL.  all  the  conditions  are 
virtually  free  of  any  magnitude  constraints,  and 
hence,  are  'global’  conditions  In  every  practical 
case,  it  is  more  than  likely  that  magnitude 
information  is  available,  eg  ./  piinr:  bounds  on 
lie*,  !;*.  .  and  ir(O)1.  as  well  a*  a  bound  on  the 
gams  of  H‘,  and  //*.  Lor  example.  Egardt  (1979) 
shows  robustness  properties  for  minimum  phase 
systems  with  bounded  output  disturbances.  Dead- 
zone  and  projection  mechanisms  can  handle  small 
unmodeled  dynamics  as  shown  by  Praly  (I983)and 
Samson  (1983).  Joannou  and  Kokotovic  (1983a. b) 
are  able  to  give  an  estimate  of  the  region  of  attrac¬ 
tion  w  ithout  SPR  or  PE  in  the  case  of  high  frequency 
parasitics.  Persistent  excitation,  and  the  resulting 
exponential  stability  property  (sec  equation  (62 1  in 
this  section)  also  leads  lo  robustness  (e  g  Anderson 
and  Johnson.  1982a. b:  Anderson  and  Johnstone. 
1983;  Kosut.  1983).  Various  other  gam  normali¬ 
zations  have  also  been  suggested  (eg  Gawlhrop 
and  Lim.  1982:  Onega  and  Landau.  1983).  These 
theoretical  results  remain  incomplete,  because  they 
do  not  as  yet  provide  a  useful  means  of  assessing  the 
impact  of  unmodcled  dynamics,  e  g  a  frequency 
domain  bound  on  model  error,  dependent  on  the 
‘return-difference  gain’  (c.g.  Doyle  and  Stein.  1981 1. 

In  this  section  we  will  show  in  Theorem  2.  under 
mild  magnitude  bounds,  that  the  adaptive  system  is 
(locally)  L,  -stable.  This  result  is  quite  general 
because  the  conditions  are  independent  of  the 
nature  of  the  adaptive  algorithm,  e  g  dcad-/ones, 
normalizations,  or  persistent  excitation 

T o  facilitate  the  analysis  we  w  ill  only  consider  the 
continuous-time  etrot  system  (21  (  with  constant 
gam  adaptation  nlonthm  (43)  h  is  convenient  to 
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li.iiitloim  i?li  u>  ilu  1 1 '  1 1 1  »w  1 1 1  l*  \  .11 1.  ilit'ii.  il  It'im 
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x  \,  <s,  l53ul 

x  \ ,  /  I  ( \  I  <53h) 

xx  hvic 


Assuming  l li.it  S'  /  -si. ihK  xxt-  t'l'i.im  ilu.- 

It'llt'XX  II1L'  It  V.ll  sl.ll'llll  x 

1 1 in n t  in : 

Suppose  lit.  -sl;ihk‘  .mil  x,  c  /  Hence.  tlieie 
exists  a  eonst.mi  <  sueli  lh.it 


x  -  (it.  e.  cl  -  <r.  -  t.’  .  i  -  <*.  s  -  s  *  l  (53c) 
x,  =  (it,,  c,  l./(xl=  u  r..  .<•)  <53dl 

Details  on  transforming  (21  I  to  (53 1  are  in  kosut 
(1983)  This  tx xi ni  of  the  adaptive  crior  system  is 
x'blained  by  linearization  ol  (21  I  about  e*.  anil 
The  Imeari/eil  perturbatii'ii  response  is  x~,. 
almost  identical  to  the  linearized  system  studied  by 
Rohrs  and  co-workers  ( 1981 1.  xxhieh  was  arrived  at 
by  a  'final  approach  analysis."  Tlie  remaining: 
nxinhnear  terms  X\,  are  contained  in  /  ( v ).  a 
memoryless  nonlinearity.  and  in  /  .  a  time-varying 
linear  operator.  The  characteristics  of  F.  as  well  as 
those  of  A,,  depend  on  the  adaptation  gam  and  the 
behavior  of  the  tuned  signals.  <•*  and  2*.  For 
example,  with  the  constant  gam  algorithm  (43).  the 
linearized  perturbation  response  is 


”i.  ■■ 

=  </  +  Lur't0 

+  K:V* 

(54a) 

=  -  H*  i*  r.L 

(54b) 

S|  : 

= 

(54c) 

with 

KS 

-K 

F  = 

H*  ( 1  -  c*  KM 

H*f*K 

(55) 

H*  ( 1  -  :*K.V) 

and'wl 

iere 

L 

1 

—  ‘  ^4(i 

(56a) 

K 

=  (/  +  LMr'L 

(56) 

M 

=  +  e* 

Hf,c* 

(56c) 

\ 

=  i'H*  +  c  *  W* 

<56d) 

Since  boundedness  of  (c*.2*)  and  stability  of 
I  arc  established  by  definition  of  the  tuned 
system,  it  is  not  difficult  to  see  that  conditions  for  the 
stability  of  F  and  the  boundedness  of  v,  are 
identical.  In  fact,  this  follow  s  if  and  only  if  the  system 
S:(.v0.  W)|-»  v,  described  by 

x  =  4„(ix  -  A/x).  v(0)  =  ,\ j,i.  R"  (57) 

is  stable  (Kosut,  1983)  Note  that  the  system  5  is 
identical  in  form  to  the  linearized  parameter  error 
system  (n„.  I*  «••)!-«  n,  in  (54) 


,  ,  (/  1 1  i  •  >  ns  i 

l hide i  these  eoinhiions.  if.  foi  some  .  •  2  t. 

I,  x ,  |; ,  1  ( I  -  .  <  2 1  {  ( 54 1 

then 

IK/  II .  <  r  (Ml) 

Pi  on]  The  proof  is  entirely  analogous  to  the  proof 
of  the  linearization  theorem  on  p  131  of  Dexoer  and 
Vidxasagar  ( 1 V75 ).  Details  for  this  case  may  be 
found  in  Kosut  (1983). 

Discussion 

Theorem  2  asserts  that  the  adaptive  system  is 
stable,  i.e.  bounded  inside  an  /  -region.  provided  that 
FeL,  -stable  and  the  linearized  response  is 
bounded  and  sufficiently  small,  i.e.  condition  (59). 
So  claims  arc  made  ahaui  the  mechanism  that 
provides  F  e  L,  -stable  and  v,eL,  As  mentioned 
earlier,  these  are  insured  if  the  map  S  defined  in  (57) 
is  L ,  -stable.  It  is  possible,  of  course,  that  x,  e  L "  but 
||vtll,  exceeds  the  magnitude  constraint  of  (59). 
Instability,  however,  does  not  follow  because 
Theorem  2  only  provides  sufficient  conditions. 

In  order  for  theorem  2  to  be  of  practical  use.  it  is 
necessary  to  provide  stability  of  S  without  relying  on 
passivity  of  H*.  We  will  illustrate  this  by  using 
persisteni  excitation.  Consider  the  system 

x  =  —  A  /  H  f  x  -+  u.  v(0 )€/?".  (61) 

It  is  shown  in  Anderson  (1977)  that  if  AeR"'". 
A  =  A’ >  0.  fePF  and  WeSPR  then  (61)  is 
exponentially  stable,  i.e.  there  exists  constants  mi. 
/.  >  0  such  that 

|v(r)j  <  Mifi,|x(0)|  +  f  mu. '  ,,ni(T||dt.  (62 ) 

•  O 

We  will  apply  (62)  to  provide  stability  of  5  as 
follows  The  system  S  can  be  written  as 

v  =  -  A„ill,,k.'\  4  A,,w  -  Ox  (63a) 
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l  ei  SPR  aiul  ,.  t  PI  with  corresponding 
positive  constants  /  anil  in  .in  defined  in  <62 1  1  hen. 
leL,  -stable  and  t  if 

/  III  ■>  1/  =  ||j|| .  Ii4!: ,  (2  -t-  |:; " ,  )■;,  (//*,  I 

k*i  .U!*i  (641 

and 

;  ,  (/?,  ,4  I  <  ('  m  -  </)  j;4|!*  .  (65) 

Proof.  Follows  directly  by  application  of  Small 
Gain  Theory  (Zamcs.  1966)  to  (63).  Details  may  be 
found  in  Kosul  (193) 

Dm  ussion 

Corollary  2.1  shows  that  persistent  excitation  is 
one  mechanism  which  provides  SeL,  -stable,  and 
hence,  boundedness  of  .\,  and  stability  of  F. 
Therefore,  if  in  addition.  \L  is  sufficiently  small  (59) 
then  the  adaptive  system  has  a  local  stability. 

Other  mechanisms  to  provide  stability  of  S 
include  dead-zones,  retardation  functions,  and 
signal  normalizations.  Their  effect  on  S  needs  to  be 
determined. 

Corollary  2.1  also  provides  an  upper  bound  on 
the  effect  of  model  error  via  (65).  This  is  not  yet  in 
the  frequency  domain  form  we  would  like,  but  the 
bound  can  be  quite  large.  Hence.  W*  need  not  he 
SPR.  but  on!>  approximately  so,  e  g  W*  eSPR. 
Think  of  H*  being  SPR  only  at  low  frequencies.  In 
the  same  way.  the  signal  ;  can  be  viewed  as  the 
dominant  part  of  4*  causing  excitation  in  that  part  of 
the  spectrum  where  the  model  error  is  small,  e.g  also 
at  low  frequencies,  loannou  and  Kokotovic  ( !9K3b) 
also  discuss  this  type  of  frequency  separation  in  the 
regressor  in  the  presence  of  high-frequency  para¬ 
sitic* 

These  results  still  remain  incomplete  because  wc 
need  to  know  the  relationships  between  /..  »i  and  the 
'si/c'of  4- e  g  Theorem  2  requires  a  bound  on  ||r,  || , . 
winch  is  a  function  of  /..  in  and  consequently  4  Of 
furlhei  interest  is  the  effect  of  dead-zones  and  signal 
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Ii)  this  papei  we  have  presented  a  fiamewoik  foi 
an  input  output  llieoiy  ol  adaptive  com  ml  'I  his 
viewpoml  piovules  a  means  to  le.ihslically  de- 
teimine  the  robustness  properties  ol  adaptive 
algorithms  Moreover,  input  output  concepts  aic 
closely  tel. tied  lo  nicasuiemeni  techniques,  and 
hence,  can  lead  to  the  delei  initiation  ol  usable 
engineering  techniques  In  conltol  design  and 
analysis  the  most  notable  example  is  the  use  of  Bode 
plots  lor  scalar  systems  (Bode.  1945i  and  singular 
value  plots  lot  multivariable  systems  (Doyle  and 
Stem.  I9M  |  At  the  present  lime,  no  similar 
'engineering  theory'  exists  for  adaptive  control 
design  Fn  mule  to  establishing  such  a  theory  it  will 
be  necessary  to  resolve  some  of  the  open  issues 
raised  herein.  The  possible  benefit  to  adaptive 
control  engineering  design  is  substantial 
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APPENDIX  B 


Multivariable  Adaptive  Control  Algorithms  and  Their  Mechanizations 

for  Aerospace  Applications 
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A.-cspe^c  crr.trcl  problems  pose  challenging 
-•  qu ;  remer.l  s  which  recent  acvances  In  adaptive  control 
are  begirr.mg  to  address.  Several  example  applications 
a:. a  a  jiscussion  of  aerospace  applications  In  general, 
centra*  t  with  pre.'irus  industrial  and  process  control 
p'Otlemc  arc  illustrate  the  class  of  problems  cf 
interest.  Because  of  tne  stringent  performance  re¬ 
quirements,  mechan i cat icn  Issues  strongly  influence 
a.goritr-  design.  Tne  freedom  possible  in  adaptive 
algorithm  design  is  outlined  below  with  particular 
e.npnasis  on  computat icnal  costs  for  various  algorithms 
and  model  forms.  !  r,  particular  the  advantages  of  the 
lattice  form  model  structure  are  pointed  out  below, 
w.t.h  a  description  of  a  new  formulation  for  the  appli¬ 
cation  of  lattice  forms  to  the  control  problem. 

Parallel  processing,  while  significant  for  many 
spoil  cat  ions  is  not  a  panacea  for  the  control  problem. 
Tne  potential  drawbacks  and  the  resolution  of  this 
Important  issue  are  addressed  in  Section  IV.  Tne 
implications  of  the  nature  of  aerospace  problems 
amenable  to  adaptive  control,  and  the  state  of  adaptive 
control  -esearcr.  suggest  a  set  of  capabilities  and 
•cols  which  will  greatly  facilitate  the  design  process. 
Tr.e  characteristics  of  these  capabilities  and  tools  and 
hr. w  they  should  be  realized  in  hardware  and  software 
are  discussed  in  Section  V.  Section  VI  summarizes  the 
major  conclusions  on  the  state  and  potential  for  adap¬ 
tive  control  application  to  aerospace  applications. 


II .  AEROSPACE  ADAPTIVE  CONTROL  PROBLEMS 

Several  aerospace  problems  with  demanding  re¬ 
quirements  have  been  addressed  recently  with  adaptive 
control  techniques.  Examples  are: 
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1.  rotorcraft  vibration  suppression  [1,2] 


2.  large  space  structure  pointing  control  [3], 
and 

3.  aircraft  wlng/store  flutter  suppression  [4], 

Each  of  these  problems  have  differing  characteristics 
which  are  summarized  in  Table  I  below. 

General  characteristics  present  in  most  aerospace 
applications  include: 


empirical  models  can  be  developed  by  ground 
vibration,  wind  tunnel,  or  flignt  tests. 

4)  Weight  and  power  constraints  put  a  hlghe- 
premium  on  computational  cost,  lr,  contrast 
to  say  a  ship  autopi-lot  or  industrial  con¬ 
troller, 


l)  High  bandwldths  and  consequently  a  high 

sampling  rate  requirement  -  rites  of  200  to 
?uGG  hertz  are  not  uncommon. 

>  Most  of  the  problems  are  multivariable, 

?>  Often  a  priori  information,  based  on  physi¬ 
cal  models  of  the  vehicle  dynamics  are  quite 
good  (certainly  better  than  the  typical 
prunes?  control  si  1  in'  li.n) .  Ever,  where 
I"  1  :  •  i  ".'ll  l'  ,i  r„.t  exist,  often  ,•  .<>1 


rj)  Aerospace  mission  requirements  generally 
require  more  comprehensive  prototyping  a  re¬ 
testing  to  reduce  full  system  test  time  ;,r,c 
ensure  high  operational  reliability. 

III.  COMPUTATIONAL  ASPECTS  OE  ADAPT  IVF  CONTROL. 

Throughout  this  paper,  we  will  denote  tne  state 
dimension  of  the  mode]  by  n  and  the  number  of  output 
by  p.  We  will  restrict  our  attention  to  tr.e  -f 

equ,  1  in|  o',  s  ar.  j  caputs. 


Tv  tl  iv<  c.T.lrul  schemi  ft  can  be  coricep- 

'  .  1  1  y  divided  In  three  party: 

(1)  Parameter  estimation  (O(n’p)  for  RLS  type 
update  0(np)  for  lattice 

(?)  Control  design  (0(1)  for  direct  adaptive 
control,  O(n’p')  for  pole-placement 

(3)  Control  update  (0(np)  for  vector  ARMAX, 
0((n«p)J)  for  a  state  space  model). 

Tr.e  second  step  may  be  trivial  for  direct  adaptive 
control.  Tne  first  two  steps  are  usually  computa¬ 
tionally  the  most  expensive. 

Figure  l  below  gives  the  computation  cost  of  stt^ 
'll  and  (?)  as  a  function  of  state  dimension  of  the 
Identified  model,  for  a  ?-input  ?-output  system  using  a 
J-li  factored  covariance  update  and  the  minimum,  variance 
.  r.fol  strategy  for  tne  self-tuning  regulator  of 
Astrom.  and  Uittenmark. 
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Figure  2.  Self-tuning  Controller  with  U-D  Update 
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-  .gure  1.  Self-tuning  Regulator  with  U-D  Update 


assumptions: 

(l)  1  flop  -  'l  floating  point  add  ♦  1  floating  point 

mult 

■  2  floating  point  adds 

'2  The  vector  ARMAX  model  has  uniform  delay* 1  from 
Input  to  output.  The  observability  Indices  of 
the  corresponding  state-space  model  are  generic, 
l.e.,  *  n/p,  (See  Hannan  [5]  on  generic  parame- 
terlzat ions). 

Figure  2  below  gives  the  computational  cost  of  Imple¬ 
menting  the  servomechanism  form  of  a  one-step  ahead 
minimum  variance  controller  as  a  function  of  state 
dimension.  Other  assumptions  are  the  same  as  for 
r igure  1 . 

One  obvious  conclusion  from  these  cost  estimates 
is  that  for  a  machine  with  floating  point  speed  of 
about  200k  flops  per  second  (about  that  of  a  VAX  11-780 
with  floating  point  hardware  for  single  precision 
arithmetic  according  to  Dongarra  [6]),  the  update  rate 
for  a  10  state  model  can  not  exceed  150  Hz  and  70  Hz 
for  the  two  cases  above. 

Figure  3  below  shows  the  achievable  rate  for  a 
machine  capable  of  performing  200k  flops  per  second  as 
a  function  of  state  dimension  for  a  2-lnput  2-output 
system.  By  comparison  the  control  update  In  step  (3) 
takes  only  An  and  6n  flops  for  the  regulator  and  con¬ 
troller  cases  mentioned  above,  and  hence  la  negligible. 
Typical  aerospace  applications  need  control 


Figure  3. 
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Achievable  Parameter  Update  Rates  on  a  VAX 
11/780  Class  Machine  for  2-lnput  2-output 
Minimum  Variance  Controller  in  Single  Preci¬ 
sion  Arithmetic.  Solid  Line  Is  for  the 
Controller  Case  and  the  Broken  Line  is  for 
the  Regulator  Case 


clear  that  one  cannot  expect  to  update  parameters  at 
the  control  update  rate,  at  least  with  a  typical  ?0Cr 
riop  serial  machine.  Most  fllght-quallf lea  machines 
available  today  are  rated  at  much  lower  speeds  compared 
to  the  VAX  11-780.  Consequently  It  Is  necessary  to 
consider  algorithms  that  use  slower  update  rates  for 
parameters,  compared  to  the  signal  sampling  rate.  It 
is  also  necessary  to  consider  parallel  hardware  for 
adaptive  control  algorithms. 

Separation  of  Update  Rates  For  Parameter  Estimation  and 
Control . 

We  consider  several  options  for  running  parameter 
estimation  at  a  slower  rate  R/k  than  tne  control  update 
rate  R.  We  assume  that  the  data  Is  available  at  a  rale 
corresponding  to  the  control  update. 

(1)  Skip  every  k-1  points  of  Input  output  data 
and  uee  the  kth  point  for  parameter  estima¬ 
tion.  Perform  rate  change  from  the  identi¬ 
fied  model  lr-  the  control  update  rale  mode. 


>.VwV»* .v-\v  • 


f'  bu 


i  ■  *  i 


■  .  •  ■  ,  ‘  ■  i  ] n '  .  I  •  i  !  i  m  tin-  .".'ill  r*  ■  1  ii  |  (1,  >t 
[..i  on  I  ill  »  a  I  trie  full  rate. 

(.'•  Perf  om  Hif  Identification  update  every  kth 

'•  .  trip.'  r  »  (fi'cS'  I'l  *.  of  the  m<  .(!•- 1  at  th* 

:  .  ■<>:•  a.  Tin  eoiitri)  atij  ldent  I  f  1  eat  loi. 

o  ■  1 :>  art  at  ttie  salt'  rate,  enabling  direct 

algorithms  to  be  used. 

The  second  alternative  has  two  advantages  over 
•a  firs'  or.t  .  The  computation  cost  of  performing 
■  .,nge  of  rate  1?  avoided,  but  more  Importantly  the 
■ .-st  method  will  result  In  k  fold  reduction  In  the 
.  Mist  rate  with  the  consequent  aliasing  and  loss  of 
nt l f  ia“  i  1  1 1 y  .  Analysis  of  the  second  alternative 
:  •  the  situation  where  ident if iatl 1 ity  is  guaranteed 
:.v  prefer  parameterization  and  persistency  of  exclta- 
tin  car  be  done  readily.  Convergence  of  the  para- 
t-ters  can  be  established  (provided  tne  SPR  condition 
o-  the  sector  condition,  see  Kosut  [8],  is  met)  by 
a  simple  modification  of  the  standard  proofs  In  Goodwin 
and  Sin  [?'.  Analysis  of  the  first  alternative  has  not 
been  done  yet. 


u.  that  will  r.i*.  th»  prediction  ,  • 

t  t  ♦  1 

current  parameter  estimate. 

When  a  wavefront  architecture  Is  used  for  lmple- 
mentation  of  the  lattice  update,  speed  up  proportional 
to  the  numbers  of  processors  can  he  achieved,  provided 
delayed  least -squares  parameter  estimates  can  be  used 
In  the  control ler. 

It  Is  straightforward  to  analyze  the  serial 
hardware  case  of  adaptive  control  by  reference  to 
results  on  the  equivalent  least-squares.  The  parallel 
architecture  algorithm  with  Its  attendant  delays  In  the 
coefficients  due  to  pipelining  has  not  been  analyzed 
rigorously  yet.  It  appears  that  If  ldent lflabll ity  cf 
the  parameters  Is  ensured  by  model  structure  select  irr. 
and  persistency  of  excitation,  then  by  Invoking  quas;- 
statlonarlty  of  the  perameter  estimates  one  could  sn;w 
stability  and  convergence. 


TABLF.  II.  ADAPTIVE  CONTROL  ALGORITHM  USING  LATTICE 
FORM: 

True  System:  A(q-'  )y  -  B(q-' )u  ♦  ( q- '  )V  Vector 
(ARMAX)  1  1 


IV.  PARALLEL  ARCHITECTURES  FOR  ADAPTIVE  CONTROL  Identification  Model: 


It  is  possible  to  Increase  the  update  rate  for 
identification  by  using  parallel  architectures  and/or 
different  algorithms.  In  particular  the  lattice  forms 
algorithms  car.  provide  very  fast  parameter  update  rates 
for  high  order  systems. Recently  Jover  and  Kallath  [10] 
have  shown  that  measurement  update  can  be  Implemented 
in  a  parallel  pipelined  form. 

Lattice  Wavefront  Architecture 

Tne  basic  lattice  form  algorithm  simply  Involves 
an  efficient  mechanism  Tor  obtaining  the  least-squares 
estimates  of  a  1  lnear-ln-paraneter  model. 

The  identification  update  uses  the  model 


am.  tne  least  squares  update  simply  produces  the  para¬ 
meter  C„  such  that  I  (y  -  y„  )*  Is  minimized. 

N  N  t-1  1  1 

Tne  steps  required  for  tne  lattice  algorithm  are 

described  in  Table  II.  The  main  advantages  of  the 

lattice  form  parameter  update  are 

(1)  0(np)  computation  cost.  However,  for  low 

parameter  dimensions  (n<l6),  U-D  Is  still 
more  cost  effective. 

(?)  Simultaneous  lower  order  model  Identifica¬ 
tion. 

(3)  Increase  In  model  order  (?p  states  per  time 
point)  is  stra ight f or  ward . 

'*•/  Suitable  for  modular  wavefront  array  pro¬ 
cessing  archl lectures  (Lev-Arl  [11]). 


(5)  It  Is  possible  to  perform  most  computations 
in  fixed  point  arithmetic. 


Lattice  form  algorithms  have  for  some  time  not 
">•. •  n  considered  appropriate  for  adaptive  control 
‘  -  ause  of  the  perceived  need  to  convert  the  lattice 
■■nm  structure  to  the  ARMAX  structure  so  that  the 
farlllar  controller  design  techniques  could  be  used. 
However,  direct  adaptive  control  laws  such  as  the 
rir.irjr  variance  type  control  can  be  implemented 
d. ceclly  witti  tne  lattice  form  model  (Shah  [1?]),  The 
i  . d*  •  i  ,  t  us-'  trial  Inputs  u^  in  the  fixed 

i‘nl-  lattice  prediction  mwdf  1  to  perorate  the 


Main  lattice  uses  past  values  of 


Joint  lattice  predicts  y.  ,|x, ,  x„  , ,  x.  . 

u* 1 1  L  1  l-m 

Identification  Method 

The  lattice  coefficients  0£  minimize 
N 

I  (yt  -  y  fJv  Vi*  Vm5’  i(N'-l)>  \  *  0  for  t 
<l6! 

Prewindowed  form,  multichannel,  cellular. 


Control  Computations: 


•  Truncate  the  model  order  if  indicated  by  low 
residuals  power. 

•  Find  the  linear  affine  map  u  |-i  y 

for  the  lattice  filter  with  the  Identified  0^.  invert 
the  map  to  obtain  ut  such  that  y  •  yref  .  This 

is  simply  linear  solution  of  p  equations1!^  p 
unknowns. 


This  algorithm  of  (1)  finding  a  linear  least 
squares  estimate  In  e.  linear  regression  model  and  (2; 
then  computing  the  control  to  make  the  prediction  based 
on  the  current  parameter  estimates  equal  to  some  known 
value,  lies  at  the  heart  of  a  large  number  of  "success¬ 
ful"  adaptive  control  algorithms.  The  same  basic 
algorithm  Is  also  used  for  recursive  prediction 
algorithms. 

Convergence  and  stability  analysis  of  these 
algorithms  has  been  done  extensively  [13-17],  Many 
practical  applications  have  also  been  reported  for  this 
class  of  algorithms.  It  la  known  that  this  class  of 
algorithm  requlges_*  Strict  Positive  Real  (SPR)  condi¬ 
tion,  l.e. ,  [C  (q  )  -|]  has  to  be  SPR  for  conver¬ 
gence. 

To  obtain  the  lattice  form  algorithm,  an  earlier 
attempt  by  Frledlander  [16]  involved  a  Joint  process 
estimation  of  the  ARMAX  system.  The  Joint  estimation 
form  Involved  the  feedback  part  of  the  system  and  the 

Implementation  requirid  computing  the  polynomial  cot!- 


*'  •  t  1  *  ’  it  i  .1  r  ,1  enforcing  1 1 1 « ■  known 

f*  **  M  r  >.  '  i’ll  the  f  st  im,il  e.s.  No  l  onvtTjit'iK  t 

>■  ■»  1  y . ■  1  r  could  to  |.t  rfi,rir.cd  and  the  numerical  burden 

"•  t.j  i r, ,  |  (if  n*  1 . 

1  r,,  1  !•  ,  II- L  Fa  lured  M.  ir.jrem.  nt  Update 

T he  mein  disadvantage  of  the  lattice  form 
1 1  gcr  i  thir.  Is  that  is  It  computationally  costly  to 
invert  lattice  form  model?  to  their  polynomial  forms. 

is  very  hard  to  convert  any  a  priori  Information, 
i:,.ch  is  generally  In  the  state-space  form,  to  the 
at t ice  form. 

Thf  u-l.  factored  measurement  update  Kalfu.ri  filter 
h  the  t.ei  t  potential  lor  incorporating  a 
-.;ri  :  r.f  ■:  r.  it  ion  in  tr.e  state-space  form.,  .’over  arid 
lie’  te.icribe  a  fa-all-  1  architecture  to  imp..— 

•  ■  tn>  r.  .i  .ar-’pent  uf.da'-*  so  that  with  riot  proc.-a- 

..  s,  eacri  performing  one  floating  point  addition  one 
loating  point  multiply  and  data  transfer  to  and  from 
ts  neighbors  in  T  units,  can  process  a  new  p  dimen- 
.tr.al  measurement  every  p(n«l)T  units,  (n  Is  the 
rate  dimension  for  the  Kalman  filter).  The  lnput- 
,-iput  delay  between  new  measurements  and  the  corres- 
icr.ding  new  state  estimates  Is  (2n«6)T  units. 

For  tne  adaptive  control  algorithms  the  state 
st mates  represent  the  parameter  estimates  and  conse- 
;uently  only  delayed  parameter  estimates  are  available 
or  ccntrol  computations.  Computation  of  the  sensi- 

ivity  matrix  -Q  ir,  the  Extended  Kalman  Filter  Formula- 

.:n  applied  to^state-space  models  (LJung  [19])  can  be 
ery  costly.  Generally  only  local  convergence  results 
be  established  in  such  cases. 


V.  TOOLS  FOR  MECHAN’l CATION  OF  ADAPTIVE  CONTROL 

Proper  tools  can  expedite  mechanizations  of 
ita;tive  control  algorithms  tremendously.  A  represen¬ 
tative  toolkit  for  various  phases  of  adaptive  control 
realization  is  described  here.  Table  3  below  sum¬ 
marizes  these  tools  and  how  they  are  used. 

Suer,  a  simulation  and  analysis  toolkit  Is  being 
developed  in  MATRIXf  /System_Bulld.  This  toolkit 
involves  two  distinct  environments  —  an  analysis  and 
simulation  environment  and  a  real-time  implementation 
environment.  Both  environments  share  the  same  model 
definition  data  structure.  The  top  three  blocks  in 
Taole  3  relate  to  analysis/simulation,  while  the  bottom 
two  are  referring  to  real-time  adaptive  control. 

Figures  A. a  -  A.c  below  show  an  example  adap- 
’  ively  controlled  system  specified  in  graphical  block 
1  agram  form.  Simulations  of  the  candidate  algorithm 
performed  before  transferring  the  control  structure 
3  real-time  processor. 


VI.  COhT’..UCI  KG  REMARKS 


1  All  1.1.  J.  A1>AP  1  1 VI  t  uNIKHI  Ml  i  HAMZAT  lies 
l-koctss  ANH  Tlkll  S 

l  1  V  tfrj  1  t  ,- 


Figure  A. a.  System_Build  Block  Diagram  cf  ar,  Adap¬ 
tively  Controlled  Plant.  (Tne  Plant  is 
Represented  by  s-domaln  pole-7160  pairs. 
The  Discrete-time  Adaptive  Control  along 
with  the  Samplers  and  ZOH  are  implemented 
in  the  SUPERKLOCK  ADAPT  or.  the  right.) 


The  bandwidth,  system  order,  MIMO  nature,  and 
■■‘•en  non-minimum  phase  characteristics  of  aerospace 
. .  t.  performance  applications  make  them  an  excellent 
,•  r.ulus  to  a  much  more  complete  working  theory  of 
...ptlve  control.  What  will  speed  the  implementation 
of  adaptive  control  laws  in  such  an  environment  la  a 
set  of  loo.-.  !„r  interactive  specif lcatlon  of  the  adap¬ 
tive  cor.trr  ;  law,  simulation  and  analysis  of  their 
pfrformanc*.  <mi  efficient  transfer  of  the  control  law 
t o  a  real-i  I nr.'iressor . 


k 


Figure  k.  t.  Discrete-time  Adaptive  Control  Algorithm 
with  Dead-zone  (see  Lgardt  [20]) 

Delay:  Generates  the  Regressor  Vector 
from  y  and 

Gain:  Computes  the  gain  for  Parameter 

Update  Using  y  and  the  Regres¬ 
sor  Vector. 

Int:  Updates  the  Parameter  Vectors 
using  the  Gain  Estimate 

Div:  Computes  the  New  Control  using 
Parameter  and  the  Regressor 
Elements. 


..-.t  t.c.  Parameter  rsrimit-  G<i  .n  Computations  using 
a  Deadzone  ( DEADZN  in  the  Diagram)  -  The 
Top  Centre  Block  Computes  the  Norm  of  the 
Regressors.  The  Remaining  Elemer.ts  Imple- 
^t-l^t-1 ^t 

ment  the  Gain  *  ^ — |j  which  is  the 
Ou' put  of  the  SUPERB!.."  cl'  JaIN. 
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APPENDIX  C 

NONLINEAR  CONTROL  DESIGN  BY  GAIN  SCHEDULING 


Since  aircraft  systems  are  predominantly  nonlinear,  it  is  necessary  to 
be  precise  about  normally  accepted  notions  used  for  linear  systems  su^h  as: 
measures  of  signal  magnitude  (norms),  gain,  stability,  etc.  The  relevant 
mathematics  and  notation  which  wr  will  use  throughou*  ,  can  be  found  in 
[Drs . 1 ] ,  [Vid  1 ] . 

2.1  INTRODUCTION 

A  highly  successful  approach  to  flight  control  design  is  gain 

scheduling.  In  fact,  this  approach  can  be  applied  to  any  nonlinear  control 

problem  A  typical  gain  scheduled  control  system  is  shown  in  Fig  2-1, 

where  P:L™  _>  U™  is  the  plant  (aircraft),  d  e  Lm  is  an  output 

disturbance  and  C:Lm  ->  Lm  *s  the  gain  scheduled  controller,  whose 

e  e  D 

gains  are  scheduled  as  a  function  of  the  actual  trajectories  (u,y).  Note 
that  C  maps  output  error’  signals  y:=  y  y  into  control  error  signals  u 
=  u  -  u. 

The  first  step  in  obtaining  C  is  to  design  a  collection  of  linear 
controllers  based  on  linear  models,  each  corresponding  to  a  particular 
reference  trajectory  (u  y)  or  flight/power  condition  in  the  flight  regime. 
Thuq.,  the  resulting  controller  gains  are  a  function  of  the  reference 
flight/power  condition  (u,y)  at  that  point.  The  control  gains  are  then 
'scheduled'  as  functions  of  the  actual  flight/power  condition  (u,y)  to 
achieve  a  continuous  non! inear  control  throughout  the  operating  envelope. 

Each  reference  (u^  y^)  generates  a  1 inea  pertur bation  model ,  denoted 
by  P.  .  Th;s  model  can  be  obtained  as  a  first  order  pe”turbation  of  P 

L  .  NL 

i 

i  .e .  , 


fWvu)  ■  p»iA  *  pl  s  *  .  <2-p> 

x 

Repeating  for  k  selected  flight  conditions  (u.  "> ,  i  =  1,  ...,  k 

yields  a  corresponding  collection  of  linear  models  { P  ,...,P  ).  In  the 

_1  Lk 

case  when  (u.  y.'  is  an  equilibrium  then  u.  and  y.  are  constants  and 

l  l  — -* -  l  J  i 


is  LTV 


P,  is  LTI.  When  (u,  ,y_. )  s  a  dynamic  trajectory,  then  P, 

L  11  L  . 

1  1 

(linear  time  varying).  Usually  only  equilibria  are  selected,  however,  to 


fully  account  for  the  behavior  of  high  performance  aircraft,  ^t  :.-s  necessary 

to  consider  dynamic  references  as  well  as  equilibrium  references. 

Having  determined  a  collection  of  linear  models  {P  .  .  ,P.  ’■ 

i  Lk 

corresponding  to  the  k-nominal  trajectories  { (u1]  ,y1 ),...,  ^uk  .y^) } ,  any 
number  of  design  techniques  can  be  used  to  determine  a  set  of  linear 


controllers  {C  ,...,C  }.  The  ith  linear  controller  C  is  indirectly  a 

L1  Lk  _  l 

function  of  the  ith  trajectory  (u.  y^).  Connecting  th:s  collection  of 

controllers  as  a  function  of  the  actual  (u  y)  is  gain  scheduling.'  The 

resulting  controller  C  is  nonlinear.  The  same  scheduling  procedure  can  be 

used  to  connect  the  collection  of  linear  models,  as  shown  in  Fig  2-2.  The 

resulting  nonlinear  model  is  often  referred  to  as  a  'simplified  nonlinear 

model,'  denoted  by  PgNL- 


Figure  2-1.  Gain-Schedu1 ed  Control  System 


Limitations  in  Theory 

A  fundamental  issue  in  the  gain  scheduling  procedure  is  that  there  is 
no  theoretical  justification  that  the  resulting  nonlinear  (gain  scheduled) 
control  will  provide  acceptable  performance  while  the  vehicle  is  in  transit 
from  one  flight/power  condition  to  another.  The  difficulty  lies  in  the  fact 
that  the  linear  models  are  only  known  to  be  valid  at  specific  conditions, 
and  no  analysis  has  been  done  to  evaluate  the  effect  of  modeling  error . 

Thus,  in  the  evaluation  phase  (Fig.  2-2),  if  performance  is  not  acceptable 
then  it  is  not  well  understood  how  to  modify  the  design. 

In  Section  ?-H  we  precisely  define  conditions  under  which  the  gain- 
scheduled  contro'ler  will  work  throughout  the  flight  envelope  despite  (not 
necessarily  small)  modeling  error  (see  Theorem  1).  A  key  element  in  this 
result  is  the  quantification  of  modeling  error,  which  is  discussed  in  the 
next  section. 

2  2  MODEL  ERROR 

The  effectiveness  of  the  linear  model  P  in  the  neighborhood  of  the 

Li 

ith  reference  ^  y . )  can  be  evaluated  from  the  test  set-up  shown  in  Fig 
2-3. 


Figure  23.  Model  Error  Test  Set-Up 


The  model  error  test  signal  is  defined  as. 


and  finite  local 


Let  A  .  have  finite  local  gain  W  .  with  bias  b 

mi  °  mi  mi 

incremental  gain  W  . .  Although  the  bias  b  .  can  be  directly  calculated 
B  mi  °  mi  J 

(2.10  it  is  not  trivial  to  find  a  corresponding  (e,  W  .)  and  (e,W 

For  example,  consider  LTI  local  gains  (W  .  ,W  .'l  with  transfer 
K  °  mi  mi 

functions  W  . (s),  W  .  (s).  Let  the  norm  be  the  L  -norm  This  is 
mi  mi  2 

convenient  since  the  L0-norm  is  connected  to  the  frequency  domain  via 
Parseval' s  Theorem,  i.e., 


x(jw)|  du 


1/2 

(2.8) 


It  is  a  simple  matter  to  select  a  sinusoidal  perturbation  u  of  frequency 

w  such  that  o  V • 2  =  t.  Thus,  W  .  can  have  any  transfer  function 

2  Ji2  mi  J 

W  .(s)  whose  norm  is  found  from  the  RMS  test, 
mi 


|W  .  (ju)l  =  rRMS(v  .  )-b.  VRMS(y.)  (2.9N 

1  mi  mi  mi  l 

Similarly,  for  two  inputs  u1  and  u^,  we  can  find  a  bound  on  the 

incremental  gain  transfer  function  W  ,(s). 

°  mi 

Figure  2~ ^  shows  modeling  error  vs.  frequency  for  the  linear  model  P 

associated  with  flight  condition  (u1  y^).  Figure  2-5  shows  the  modeling 
error  vs.  frequency  for  flight  condition  Note  the  increased 

modeling  error  when  using  the  model  P  for  a  different  flight  condition 

Also,  the  error  in  Figs.  2-5  and  2-6  remains  substantially  unaffected  for 

frequencies  above  w  where  the  linear  model  is  not  valid 

m 


Figure  2-4.  Model  Error  vs.  Frequency 


These  tests  can  be  repeated  for  each  of  the  selectfd  flight  conditions  to 
yield  error  curves  like  Fig.  2-4.  Although  these  curves  are  readily 
obtainable  from  available  test  data,  in  practice  they  never  are  obtained, 
because  it  is  not  clear  how  to  use  them.  The  IMAC  procedure,  however,  will 
exploit  this  data. 

Limitations 

Although  this  procedure  works  for  LTI  systems  fsee,  e.g.,  [Kos.i])  it 
doe-  not  hold  for  NL  systems,  since  sums  of  sinusoids  at  the  input  do  not 
produce  the  same  frequencies  at  the  output.  In  other  words,  we  do  not  know 
how  to  span  the  input/output  space  of  an  arbitrary  nonlinear  system.  This 
is  an  area  for  further  basic  research. 

Control  Gain  Error 

The  preceding  discussion  about  model  error  can  be  repeated  exactly  for 
control  gain  error ,  defined  as: 


v  . 
gi 


Cu  -  u 
1 


(2  10) 


where  C  is  the  gain  scheduled  controller  and  C,  is  the  linear 


controller  corresponding  to  the  ith  reference  (u^,y.).  The  ;  est  set-up  is 

shown  in  Fig.  2-5.  By  analogy  with  (2.7)  introduce  the  nonlinear  gain 

error  operator  A  .  :  Lm  — >  Lm  ,  defined  implicitly  by 
g  1  pe  pe 


v  . 
gi 


A  .  u 
gi 


(2.11) 


Let  A  .  have  finite  local  gain  W  . 
gi  _  gi 

incremental  gain  W  . . 

gi 


(with  zero  bias)  and  finite 


2.3  THEORETICAL  BASIS  FOR  IMAC 

The  theoretical  foundation  for  our  IMAC  methodology  is  to 
quantitatively  assess  the  impact  of  model  error  and  gain  error  on  control 
objectives.  Using  the  definitions  of  model  error  (2.7)  and  gain  erro>- 
(2.11),  the  gain-scheduled  system  (Fig.  2-H)  can  be  put  in  the  form  shown  in 
Fig.  2-6  where 


e  =  eL  -  Cv 


v  =  Ac 


( 2  12) 


Figure  2  5.  Gain  Error  Tes 


Figure  2-6.  Equivalent  Gain-Scheduled  System 


Results  on  stability  and  performance  robustness  are  contained  in  Theorem  1, 
bel ow . 


Theorem  1  : 

Consider  the  system  of  Fig.  2-6,  as  described  by  (2  12).  Assume  that: 


( A 1  )  e.  c  Lm 

L  p 

( A2)  G  e  L  -stable  (G  is  also  linear) 

P 

(A3)  A  has  finite  local  gain,  i.e  ,  V  W  e  L  stable  and  Vb  >  0, 
e  >  0  such  that:  P 

|  | e  |  |  <  e  =>  I  lAa| |  <  |  jwel I  +  b 

P  —  P  -  P 

(AM)  A  has  finite  local  incremental  gain,  i.e.,  V  W  e  L  stable, 
t  >  0  such  that:  P 


Under  these  conditions,  the  system  is  (locally) 


L  -stable  if: 
P 


(i)  Y  (WG)  <  1 
P 

(ii>  I  I eL  I  lp  <  E  <  e 

IMlpi  E  +  ^p(G)[1-^p(WG)]_1[Y(W)i  +  b]  <  e 


(iii ) 


Proof: 

Application  of  the  Linearization  Theorem  of  fDes.1], 

General  Remarks 

Assumptions  (A1  )  and  (A2)  assert  that  the  closed-loop  perturbation 
(local)  system  is  stable.  This,  of  course,  is  established  by  the  local 
design  procedure 

The  remarkable  aspect  of  Theorem  1  is  that  conditions  (i)  -  (iii), 
which  guarantee  stability  and  performance,  only  invol ve  linear  operators , 
despite  the  fact  that  the  actual  system  (Fig.  2-M)  i_s  nonl  inear .  The 
effects  of  the  actual  nonlinear  system  appear  implicitly  in  the  local 
gains/bias  (W,  W,b).  Conditions  'i)  -  (iii)  must  be  repeated  along  the 
significant  equilibrium  and  dynamic  references  in  the  flight  envelope. 

Stability  Robustness 

Condition  (i)  is  a  generalization  of  the  usual  stability  robustness 
test  (see,  e.g.,  [Doy.1],  [Saf.1],  [Kos.l])  but  includes  LTV  systems  as  well 
as  LTI  systems. 

Performance  Robustness 

Conditions  (ii)  (iii)  must  be  satisfied  to  guarantee  that 
II  Hip  <  e,  i.e.,  given  model  error  (W,  W)  and  performance  tolerance  e, 
then  it  remains  to  select  such  that  (ii)  -  (iii)  is  satisfied.  These 

conditions  provide  the  means  to  quantitatively  modify  unacceptable 
performance  (see  flowchart  in  Fig.  2-5). 

In  the  case  where  the  actual  system  is  LTI  (P,PNL  G  G)»  all  the  gain 
operators  v  ( . )  in  (i)  -  (iii)  can  be  replaced  with  the  matrix  norm  2  2 
and  (i)  -  (iii)  become  frequency  dependent  (see,  e.g.,  [Kos  1]  for  details). 
This  property  is  lost  for  the  nonlinear  problem  at  hand. 


Selection  of  Norm  Measure 


The  L,,  norm,  which  is  useful  in  model  error  analysis  and  stability 

robustness,  does  not  give  a  complete  performance  measure.  For  example, 

1 1 e I  1 2  —  a  does  not  preclude  |e(t)j  >>  a  for  some  t  e  [O,®).'  However, 

lleH.  <  8  together  with  |Je||2  <  a  gives  a  more  complete  performance 

evaluation.  Conditions  (i)  (iii)  can  be  used  with  the  L  norm  but  this 

00 

impacts  the  model  error  (or  gain  error)  test  procedure,  and  opens  an  area 
for  basic  research  in  model  error  testing 

2.4  MODEL  ERROR  ALLOCATION 

Theorem  1  provides  the  means  to  examine  the  model  error  allocation 
problem:  given  performance  bounds  (e,  e)  find  allowable  model  error  (W, 

W  b).  This  is  a  difficult  and  important  problem,  since  the  solution  allows 
for  approximate  model  building  and  evaluation  at  an  early  stage  of  design. 

Consider  the  simple  case  where  local  gain  and  local  incremental  gain 
are  approximately  identical,  i.e., 


W  *  W  (2.10) 

For  sufficiently  small  (e,e)  it  is  possible  that  W  is  close  to  W. 
However,  even  under  these  simple  conditions  we  cannot  isolate  W  in  (2.14) 
without  introducing  undue  conservatism.  Specifically,  although 

Y  (WG)  <  y  (W)Y  (G)  (2.11) 

P  ~  P  P 

it  is  possible  that  Y  (WG)  <<  Y  (W)Y  (G),  ergo,  significant  conservatism. 

P  P  P 

Even  so,  (2.10),  (2.11),  together  with  (2.14)  give, 


Although  (2.12)  is  only  an  approximate  ipossib'y  highly  conservative) 
solution  to  model  error  allocation,  we  propose  to  investigate  conditions 
under  which  it  is  appropriate.  This  will  provide  a  useful  first  s*-ep  in  the 
study.  In  particular,  we  will  also  consider  simple  types  of  nonl-inear 
systems,  such  as  P  of  (2.9)  which  has  a  single  slope  restricted 
memoryless  nonlinearity.  After  studying  that  simple  form  we  will  examine 
more  complicated  cases  involving  interconnections  of  slope  restricted 
memoryless  nonlinearities. 
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